00000001:02000400:2.0F:1788752709.538875:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788752726.877768:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788752728.510574:0:3238:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 549 MB/s 00000001:01000000:2.0:1788752728.760878:0:3238:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 795 MB/s 00000001:01000000:3.0:1788752729.010269:0:3238:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4067 MB/s 00000020:02000000:2.0:1788752729.769678:0:3271:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_43_g6a42d2c 00000400:02000000:0.0F:1788752730.715281:0:3286:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.105@tcp [8/256/0/180] 00008000:02000000:3.0:1788752734.177470:0:3436:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788752780.490855:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788752789.319783:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788752789.319789:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788752789.319895:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000edceb8a2 00000080:02000400:2.0:1788752789.319906:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788752789.326109:0:5814:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788752789.326211:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788752789.326252:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fbdb9f11) 00000020:00000080:2.0:1788752789.326272:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1788752789.344530:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788752789.344937:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788752789.369009:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788752789.369156:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788752789.369182:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788752789.369235:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788752789.370990:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788752789.371605:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788752789.371614:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788752789.371623:0:5814:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f4848fa79 00000020:01000004:1.0:1788752789.371631:0:5814:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1788752789.371636:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788752789.371640:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000edceb8a2 from MGS 00000020:01000004:1.0:1788752789.371645:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788752789.371725:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003cc501c1) 00000020:00000080:1.0:1788752789.371739:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788752789.371850:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000edceb8a2 from MGS, refs=2 00080000:01000000:1.0:1788752789.371856:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788752789.371861:0:5814:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f4848fa87 00000100:00100000:1.0:1788752789.371955:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788752789.372562:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788752789.372570:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788752789.373279:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788752789.373287:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788752789.374246:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788752789.374622:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788752789.374628:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788752789.375535:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788752789.375544:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788752789.376564:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788752789.376573:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788752789.377520:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752789.377524:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752789.377526:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752789.377778:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752789.377781:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752789.377782:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752789.379397:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788752789.380697:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788752789.632600:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2142 MB/s 00000001:01000000:2.0:1788752789.883099:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4091 MB/s 00000001:01000000:2.0:1788752790.133828:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 731 MB/s 00000001:01000000:1.0:1788752790.383536:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 851 MB/s 00080000:10000000:1.0:1788752790.389048:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788752790.402484:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788752790.402500:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788752790.402503:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788752790.403082:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788752790.403159:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788752790.403191:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788752790.403329:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788752790.403352:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788752790.403656:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788752790.403822:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788752790.403828:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788752790.407632:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788752790.407644:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788752790.407968:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788752790.407974:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788752790.408518:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788752790.408538:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.105@tcp' 00000020:01000004:0.0:1788752790.408540:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788752790.408579:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.105@tcp (typ=mgc) 00000020:00000080:0.0:1788752790.408598:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.105@tcp (000000000feca38b) 00000020:00000080:0.0:1788752790.408615:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788752790.408734:0:5814:0:(ldlm_lib.c:103:import_set_conn()) imp 000000004522877a@MGC192.168.203.105@tcp: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1788752790.408908:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.105@tcp-0 is initialized 00000040:01000000:0.0:1788752790.408915:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788752790.409323:0:5828:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788752790.409359:0:5829:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788752790.409388:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.105@tcp (uuid b577cb32-91f9-472d-9b00-c1edbc016b63) 00000020:00000080:2.0:1788752790.409412:0:5814:0:(genops.c:1384:class_connect()) connect: client b577cb32-91f9-472d-9b00-c1edbc016b63, cookie 0x80c8383f4848fa95 00000100:00080000:2.0:1788752790.409421:0:5814:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788752790.409434:0:5814:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import 000000004522877a using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1788752790.409471:0:5814:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003f3c756e x1875643182612608/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788752790.409492:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b577cb32-91f9-472d-9b00-c1edbc016b63->MGS 00000020:01000004:2.0:1788752790.409507:0:5814:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788752790.409527:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788752790.409537:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000009e2a5433) 00000020:00000080:2.0:1788752790.409546:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788752790.411268:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f3c756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b577cb32-91f9-472d-9b00-c1edbc016b63:3302:1875643182612608:0@lo:250: 00000100:00100000:0.0:1788752790.411353:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752790.411418:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182612608 00000100:00100000:0.0:1788752790.411426:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182612608 00000100:00100000:0.0:1788752790.411459:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788752790.411465:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006d2270cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875643182612608:12345-0@lo:250: 00010000:00080000:0.0:1788752790.411489:0:5825:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from b577cb32-91f9-472d-9b00-c1edbc016b63@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788752790.411513:0:5825:0:(genops.c:1384:class_connect()) connect: client b577cb32-91f9-472d-9b00-c1edbc016b63, cookie 0x80c8383f4848faa3 00000100:00080000:0.0:1788752790.411685:0:5825:0:(import.c:65:import_set_state_nolock()) 0000000066c6259d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788752790.411732:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006d2270cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+5:3302:x1875643182612608:12345-0@lo:250: Request processed in 265us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752790.411739:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788752790.411862:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.105@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788752790.411870:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.105@tcp: connect to target with instance 0 00000100:00080000:0.0:1788752790.411878:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.105@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788752790.411882:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788752790.411891:0:3302:0:(import.c:65:import_set_state_nolock()) 000000004522877a MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788752790.411894:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788752790.411903:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788752790.411907:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f3c756e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b577cb32-91f9-472d-9b00-c1edbc016b63:3302:1875643182612608:0@lo:250: 00000100:00100000:2.0:1788752790.433510:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788752790.433703:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788752790.433709:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788752790.436267:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788752790.436281:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788752790.442001:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788752790.442018:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788752790.444599:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788752790.444944:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788752790.444951:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788752790.445595:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788752790.445603:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00010000:00010000:1.0:1788752790.453021:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752790.503070:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788752790.503457:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788752790.503465:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788752790.505371:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788752790.505386:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788752790.505967:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788752790.506574:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788752790.506580:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788752790.507013:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788752790.507019:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788752790.507616:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788752790.507756:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788752790.507773:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788752790.508450:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788752790.508457:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788752790.508939:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788752790.509079:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788752790.509084:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788752790.509629:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788752790.509635:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788752790.527505:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788752790.527744:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788752790.527751:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788752790.529520:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788752790.529539:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788752790.530298:0:5814:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788752790.530304:0:5814:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788752790.531658:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788752790.531680:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788752790.531686:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788752790.531838:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788752790.531873:0:5814:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788752790.531877:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788752790.531879:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788752790.531880:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788752790.531881:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788752790.531883:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788752790.531884:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788752790.531885:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788752790.531887:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788752790.531888:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788752790.531889:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788752790.531895:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788752790.531897:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788752790.531899:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788752790.531902:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788752790.531903:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788752790.531904:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788752790.531904:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788752790.531905:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788752790.531906:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788752790.531907:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788752790.531908:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788752790.531908:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788752790.531909:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788752790.531910:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788752790.531911:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788752790.531943:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788752790.531959:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c2ebbee1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182612736:0@lo:253: 00000100:00100000:0.0:1788752790.532022:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752790.532152:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000072286014 going to sleep for 11 seconds 00000100:00100000:2.0:1788752790.532324:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182612736 00000100:00100000:2.0:1788752790.532331:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182612736 00000100:00100000:2.0:1788752790.532409:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752790.532418:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007ce748c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+5:5814:x1875643182612736:12345-0@lo:253: 20000000:01000000:2.0:1788752790.532459:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788752790.532462:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788752790.532734:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788752790.532794:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788752790.533097:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788752790.534328:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788752790.535536:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788752790.535541:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788752790.535546:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788752790.535549:0:5827:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788752790.535564:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788752790.535799:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788752790.535977:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788752790.535989:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788752790.536069:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788752790.536458:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788752790.536500:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788752790.536587:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788752790.536595:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788752790.536652:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788752790.536661:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788752790.536694:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788752790.536701:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788752790.536731:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788752790.536800:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788752790.536833:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788752790.536838:0:5827:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788752790.536850:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788752790.537035:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788752790.537045:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788752790.538634:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788752790.538680:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788752790.538737:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788752790.538750:0:5827:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788752790.538863:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788752790.538873:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788752790.538917:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788752790.538951:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788752790.538982:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788752790.538992:0:5827:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788752790.539611:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788752790.539624:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788752790.539665:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788752790.539699:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788752790.539885:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788752790.539933:0:5827:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788752790.539941:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788752790.540644:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788752790.540839:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788752790.540860:0:5827:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.105@tcp for mdt 20000000:01000000:3.0:1788752790.540862:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788752790.540896:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788752790.540904:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788752790.540935:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788752790.540943:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:3.0:1788752790.540990:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788752790.541001:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788752790.541034:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788752790.541499:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788752790.541576:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788752790.541580:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788752790.541583:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788752790.541594:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788752790.541597:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788752790.541625:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788752790.541627:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788752790.547847:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788752790.548172:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788752790.548212:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788752790.548294:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788752790.548306:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788752790.548308:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788752790.548742:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788752790.548937:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788752790.548972:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788752790.548998:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788752790.549009:0:5827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788752790.549012:0:5827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788752790.549016:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788752790.549018:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788752790.549029:0:5827:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788752790.549035:0:5827:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788752790.549409:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788752790.549584:0:5827:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788752790.562088:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788752790.562203:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788752790.562271:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788752790.562290:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788752790.562325:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562342:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562352:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562358:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562364:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562370:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562376:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a6d462d already unused, calling callback (00000000378590ea) 00010000:00010000:3.0:1788752790.562380:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562386:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562648:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562655:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.562660:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a6d462d/0x80c8383f4848faaa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788752790.562675:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788752790.806685:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007ce748c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+5:5814:x1875643182612736:12345-0@lo:253: Request processed in 274262us (274657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752790.806705:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788752790.806843:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c2ebbee1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182612736:0@lo:253: 10000000:01000000:3.0:1788752790.806859:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788752790.806861:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788752790.806863:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788752790.806864:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788752790.806866:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788752790.806867:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788752790.806868:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788752790.806869:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788752790.806870:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788752790.806872:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788752790.806873:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788752790.806874:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788752790.806891:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000edceb8a2 from lustre-MDT0000 10000000:01000000:3.0:1788752790.806914:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788752790.806917:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788752790.806920:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c9b8731b380 10000000:01000000:3.0:1788752790.806924:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788752790.806931:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c9b8731b380 from 1 10000000:01000000:3.0:1788752790.806934:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788752790.806989:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 000000000a6d462d/0x80c8383f4848fab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.807011:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 000000000a6d462d/0x80c8383f4848fab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.807019:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 000000000a6d462d/0x80c8383f4848fab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752790.807104:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182612864:0@lo:101: 00000100:00100000:3.0:1788752790.807188:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752790.807325:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000004214c73b going to sleep for 11 seconds 00000100:00100000:0.0:1788752790.807383:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182612864 00000100:00100000:0.0:1788752790.807399:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182612864 00000100:00100000:0.0:1788752790.807435:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788752790.807443:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e42f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+5:5814:x1875643182612864:12345-0@lo:101: 00010000:00010000:0.0:1788752790.807455:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752790.807466:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050cdb066/0x80c8383f4848fab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fab1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752790.807489:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050cdb066/0x80c8383f4848fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752790.807499:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050cdb066/0x80c8383f4848fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752790.807508:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050cdb066, rc 0) 00000100:00100000:0.0:1788752790.807553:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e42f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+6:5814:x1875643182612864:12345-0@lo:101: Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752790.807560:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788752790.807635:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182612864:0@lo:101: 00010000:00010000:3.0:1788752790.807647:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 000000000a6d462d/0x80c8383f4848fab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.807655:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 000000000a6d462d/0x80c8383f4848fab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752790.807700:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182612992:0@lo:501: 00000100:00100000:3.0:1788752790.807726:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752790.807748:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000004214c73b going to sleep for 11 seconds 00000100:00100000:0.0:1788752790.807808:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182612992 00000100:00100000:0.0:1788752790.807812:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182612992 00000100:00100000:0.0:1788752790.807833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788752790.807838:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000242559e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+6:5814:x1875643182612992:12345-0@lo:501: 00000100:00100000:0.0:1788752790.808056:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000242559e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+6:5814:x1875643182612992:12345-0@lo:501: Request processed in 218us (329us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788752790.808062:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788752790.808191:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182612992:0@lo:501: 10000000:01000000:3.0:1788752790.808215:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788752790.808232:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 000000000a6d462d/0x80c8383f4848fab1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.808310:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 000000000a6d462d/0x80c8383f4848fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752790.808330:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c9b90a5a800 10000000:01000000:3.0:1788752790.808334:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788752790.808339:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c9b90a5a800 10000000:01000000:3.0:1788752790.808342:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788752790.808344:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c9b90a5a800 from 1 10000000:01000000:3.0:1788752790.808347:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788752790.808364:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 0000000090536f8e/0x80c8383f4848fabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.808372:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 0000000090536f8e/0x80c8383f4848fabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.808380:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 0000000090536f8e/0x80c8383f4848fabf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752790.808392:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613120:0@lo:101: 00000100:00100000:3.0:1788752790.808417:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752790.808590:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182613120 00000100:00100000:0.0:1788752790.808596:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182613120 00000100:00100000:0.0:1788752790.808626:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788752790.808631:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029bf3d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+6:5814:x1875643182613120:12345-0@lo:101: 00010000:00010000:0.0:1788752790.808639:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752790.808648:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aaac67ee/0x80c8383f4848fac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fabf expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752790.808662:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aaac67ee/0x80c8383f4848fac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fabf expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752790.808670:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aaac67ee/0x80c8383f4848fac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fabf expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752790.808677:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aaac67ee, rc 0) 00000100:00100000:0.0:1788752790.808701:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029bf3d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+7:5814:x1875643182613120:12345-0@lo:101: Request processed in 70us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752790.808706:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788752790.808848:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000004214c73b going to sleep for 11 seconds 00000100:00100000:3.0:1788752790.808860:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613120:0@lo:101: 00010000:00010000:3.0:1788752790.808870:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 0000000090536f8e/0x80c8383f4848fabf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.808877:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 0000000090536f8e/0x80c8383f4848fabf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752790.808888:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788752790.808933:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 0000000090536f8e/0x80c8383f4848fabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.808951:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 0000000090536f8e/0x80c8383f4848fabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752790.808956:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788752790.808959:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788752790.808963:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c9b90a5a800 10000000:01000000:3.0:1788752790.808965:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788752790.808968:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788752790.808969:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788752790.808982:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000450819cb/0x80c8383f4848facd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.808988:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000450819cb/0x80c8383f4848facd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.808994:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000450819cb/0x80c8383f4848facd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752790.809005:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613248:0@lo:101: 00000100:00100000:3.0:1788752790.809028:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752790.809119:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000004214c73b going to sleep for 11 seconds 00000100:00100000:1.0:1788752790.809197:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182613248 00000100:00100000:1.0:1788752790.809202:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182613248 00000100:00100000:1.0:1788752790.809235:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788752790.809354:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db8598dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+7:5814:x1875643182613248:12345-0@lo:101: 00010000:00010000:1.0:1788752790.809363:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752790.809372:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000638ebe67/0x80c8383f4848fad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848facd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752790.809387:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000638ebe67/0x80c8383f4848fad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848facd expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752790.809407:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000638ebe67/0x80c8383f4848fad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848facd expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752790.809413:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000638ebe67, rc 0) 00000100:00100000:1.0:1788752790.809441:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db8598dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+8:5814:x1875643182613248:12345-0@lo:101: Request processed in 90us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752790.809446:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788752790.809573:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613248:0@lo:101: 00010000:00010000:3.0:1788752790.809583:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000450819cb/0x80c8383f4848facd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752790.809590:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000450819cb/0x80c8383f4848facd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752790.809641:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613376:0@lo:501: 00000100:00100000:3.0:1788752790.809664:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752790.809690:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000004214c73b going to sleep for 11 seconds 00000100:00100000:2.0:1788752790.809750:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182613376 00000100:00100000:2.0:1788752790.809754:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182613376 00000100:00100000:2.0:1788752790.809791:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788752790.809797:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf2cbbfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+8:5814:x1875643182613376:12345-0@lo:501: 00000100:00100000:2.0:1788752790.809994:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf2cbbfd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5814:x1875643182613376:12345-0@lo:501: Request processed in 197us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752790.810001:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788752790.810227:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613376:0@lo:501: 00000100:00100000:3.0:1788752790.810563:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613504:0@lo:503: 00000100:00100000:3.0:1788752790.810606:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752790.810632:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000004214c73b going to sleep for 11 seconds 00000100:00100000:1.0:1788752790.810688:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182613504 00000100:00100000:1.0:1788752790.810694:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182613504 00000100:00100000:1.0:1788752790.810725:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788752790.810731:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cc15d754 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5814:x1875643182613504:12345-0@lo:503: 00000100:00100000:1.0:1788752790.810901:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cc15d754 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5814:x1875643182613504:12345-0@lo:503: Request processed in 170us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752790.810907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788752790.811024:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613504:0@lo:503: 00000100:00100000:3.0:1788752790.811769:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5856:1875643182613632:0@lo:502: 00000100:00100000:3.0:1788752790.811812:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752790.811843:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017909106 going to sleep for 11 seconds 00000100:00100000:1.0:1788752790.811894:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182613632 00000100:00100000:1.0:1788752790.811900:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182613632 00000100:00100000:1.0:1788752790.811933:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788752790.811940:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b5626cef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5856:x1875643182613632:12345-0@lo:502: 00000100:00100000:1.0:1788752790.812504:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b5626cef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5856:x1875643182613632:12345-0@lo:502: Request processed in 563us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752790.812512:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788752790.812641:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5856:1875643182613632:0@lo:502: 00000020:01000000:3.0:1788752790.812666:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752790.812677:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752790.812679:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788752790.812685:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788752790.812688:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788752790.812709:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bf6cc53a) 00000020:00000080:3.0:1788752790.812727:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788752790.812733:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788752790.812849:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788752790.812856:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f4848fae2 00000020:00000080:3.0:1788752790.813155:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788752790.813160:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752790.813163:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752790.813169:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788752790.813173:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752790.813176:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752790.813177:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788752790.813180:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788752790.813187:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004b0b3740) 00000020:00000080:3.0:1788752790.813197:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788752790.813201:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788752790.813202:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788752790.813205:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788752790.813211:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788752790.813327:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000edceb8a2 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788752790.813339:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005e32d3ee) 00000020:00000080:3.0:1788752790.813356:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788752790.813471:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788752790.813477:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f4848faf7 00000020:00000080:3.0:1788752790.813586:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788752790.813592:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788752790.813596:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x80c8383f4848fafe 00080000:01000000:3.0:1788752790.813601:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788752790.813604:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f4848fb05 00080000:10000000:3.0:1788752790.813984:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788752790.814513:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788752790.820874:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788752790.955855:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788752790.959045:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788752790.968690:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788752790.970609:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788752791.039696:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b9a325d9) 00000020:00000080:1.0:1788752791.039715:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788752791.039789:0:5856:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788752791.039796:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f4848fb13 00000020:00000080:1.0:1788752791.042338:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788752791.049720:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788752791.132605:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788752791.161103:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788752791.240592:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788752791.292713:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788752791.352962:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788752791.380158:0:5856:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x80c8383f4848fb1a 00000020:00000080:0.0:1788752791.380603:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788752791.380613:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752791.380619:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752791.380622:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788752791.380625:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788752791.380629:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752791.380630:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788752791.380633:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788752791.380635:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788752791.380638:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752791.380640:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752791.380641:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788752791.380643:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788752791.380647:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752791.380648:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788752791.380652:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788752791.380685:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788752791.380737:0:5856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000194a9f68 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5856:1875643182613760:0@lo:502: 00000100:00100000:0.0:1788752791.380826:0:5856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752791.380871:0:5856:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7fe9376 going to sleep for 11 seconds 00000100:00100000:2.0:1788752791.380964:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182613760 00000100:00100000:2.0:1788752791.380971:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182613760 00000100:00100000:2.0:1788752791.381048:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788752791.381057:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b5cc3b6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5856:x1875643182613760:12345-0@lo:502: 00000100:00100000:2.0:1788752791.381408:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b5cc3b6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5856:x1875643182613760:12345-0@lo:502: Request processed in 352us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752791.381415:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788752791.381511:0:5856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000194a9f68 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5856:1875643182613760:0@lo:502: 00000020:01000000:0.0:1788752791.381540:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752791.381546:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752791.381548:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788752791.381552:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788752791.381895:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788752791.381914:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788752791.382011:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 00000000450819cb/0x80c8383f4848facd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.382022:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 00000000450819cb/0x80c8383f4848facd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752791.382030:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9b90a5a800 from 1 10000000:01000000:1.0:1788752791.382040:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788752791.382078:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.382085:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.382094:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752791.382109:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008289f77e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613888:0@lo:101: 00000100:00100000:1.0:1788752791.382170:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752791.382198:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e6683d2 going to sleep for 11 seconds 00000100:00100000:0.0:1788752791.382281:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182613888 00000100:00100000:0.0:1788752791.382293:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182613888 00000100:00100000:0.0:1788752791.382318:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788752791.382335:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f200d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+9:5814:x1875643182613888:12345-0@lo:101: 00010000:00010000:0.0:1788752791.382346:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752791.382357:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fb21 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.382378:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.382502:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.382511:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000922ad32b, rc 0) 00000100:00100000:0.0:1788752791.382543:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f200d78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+10:5814:x1875643182613888:12345-0@lo:101: Request processed in 210us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752791.382549:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788752791.382634:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008289f77e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182613888:0@lo:101: 00010000:00010000:1.0:1788752791.382647:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.382655:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752791.383256:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008289f77e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614016:0@lo:256: 00000100:00100000:1.0:1788752791.383300:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752791.383328:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e6683d2 going to sleep for 11 seconds 00000100:00100000:2.0:1788752791.383508:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614016 00000100:00100000:2.0:1788752791.383515:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614016 00000100:00100000:2.0:1788752791.383551:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788752791.383559:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e2e46be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+10:5814:x1875643182614016:12345-0@lo:256: 20000000:01000000:2.0:1788752791.383574:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788752791.383580:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788752791.383640:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e2e46be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+10:5814:x1875643182614016:12345-0@lo:256: Request processed in 83us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752791.383647:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788752791.383861:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008289f77e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614016:0@lo:256: 10000000:01000000:1.0:1788752791.384686:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788752791.384822:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.384835:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752791.384855:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9b90a5a800 from 1 10000000:01000000:1.0:1788752791.384858:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788752791.384888:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.384895:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.384904:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752791.384919:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008289f77e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614144:0@lo:101: 00000100:00100000:1.0:1788752791.384963:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752791.385037:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e6683d2 going to sleep for 11 seconds 00000100:00100000:2.0:1788752791.385107:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614144 00000100:00100000:2.0:1788752791.385113:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614144 00000100:00100000:2.0:1788752791.385306:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788752791.385313:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000225aca20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+10:5814:x1875643182614144:12345-0@lo:101: 00010000:00010000:2.0:1788752791.385325:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752791.385338:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fb2f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752791.385359:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752791.385380:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752791.385500:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001d4d0998, rc 0) 00000100:00100000:2.0:1788752791.385550:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000225aca20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5814:x1875643182614144:12345-0@lo:101: Request processed in 237us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752791.385556:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788752791.385643:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008289f77e pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614144:0@lo:101: 00010000:00010000:3.0:1788752791.385657:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752791.385663:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752791.385729:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614272:0@lo:501: 00000100:00100000:3.0:1788752791.385766:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752791.385793:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010083d88 going to sleep for 11 seconds 00000100:00100000:1.0:1788752791.385851:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614272 00000100:00100000:1.0:1788752791.385857:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614272 00000100:00100000:1.0:1788752791.385890:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788752791.385897:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009d481062 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5814:x1875643182614272:12345-0@lo:501: 00000100:00100000:1.0:1788752791.386682:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009d481062 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5814:x1875643182614272:12345-0@lo:501: Request processed in 785us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752791.386689:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788752791.386803:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614272:0@lo:501: 00000100:00100000:3.0:1788752791.386844:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614400:0@lo:503: 00000100:00100000:3.0:1788752791.386874:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752791.386898:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000010083d88 going to sleep for 11 seconds 00000100:00100000:2.0:1788752791.386912:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614400 00000100:00100000:2.0:1788752791.386918:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614400 00000100:00100000:2.0:1788752791.386951:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788752791.386957:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b04a4234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5814:x1875643182614400:12345-0@lo:503: 00000040:00080000:2.0:1788752791.386993:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788752791.387038:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b04a4234 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5814:x1875643182614400:12345-0@lo:503: Request processed in 81us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752791.387045:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788752791.387185:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614400:0@lo:503: 00000040:00080000:3.0:1788752791.388105:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788752791.388298:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788752791.388315:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788752791.388331:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.388342:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752791.388395:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788752791.388397:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c9b90a5a800 10000000:01000000:1.0:1788752791.388399:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c9b90a5a800 10000000:01000000:1.0:1788752791.388402:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788752791.388405:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9b90a5a800 from 1 10000000:01000000:1.0:1788752791.388407:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788752791.388431:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 0000000058fbb0fe/0x80c8383f4848fb3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.388438:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 0000000058fbb0fe/0x80c8383f4848fb3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.388447:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 0000000058fbb0fe/0x80c8383f4848fb3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752791.388464:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614528:0@lo:101: 00000100:00100000:1.0:1788752791.388511:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752791.388536:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009635be1 going to sleep for 11 seconds 00000100:00100000:2.0:1788752791.388656:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614528 00000100:00100000:2.0:1788752791.388666:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614528 00000100:00100000:2.0:1788752791.388699:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788752791.388705:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060d84078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5814:x1875643182614528:12345-0@lo:101: 00010000:00010000:2.0:1788752791.388716:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752791.388727:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035444863/0x80c8383f4848fb44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fb3d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752791.388746:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035444863/0x80c8383f4848fb44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752791.388764:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035444863/0x80c8383f4848fb44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752791.388779:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035444863, rc 0) 00000100:00100000:2.0:1788752791.388818:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060d84078 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5814:x1875643182614528:12345-0@lo:101: Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752791.388824:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788752791.388902:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614528:0@lo:101: 00010000:00010000:1.0:1788752791.388914:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 0000000058fbb0fe/0x80c8383f4848fb3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752791.388921:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 0000000058fbb0fe/0x80c8383f4848fb3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752791.388957:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614656:0@lo:501: 00000100:00100000:1.0:1788752791.388973:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752791.388994:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009635be1 going to sleep for 11 seconds 00000100:00100000:0.0:1788752791.389010:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614656 00000100:00100000:0.0:1788752791.389015:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614656 00000100:00100000:0.0:1788752791.389044:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788752791.389050:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000514185dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5814:x1875643182614656:12345-0@lo:501: 00000100:00100000:0.0:1788752791.389544:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000514185dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5814:x1875643182614656:12345-0@lo:501: Request processed in 494us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752791.389552:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788752791.389598:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614656:0@lo:501: 00000100:00100000:1.0:1788752791.389626:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614784:0@lo:503: 00000100:00100000:1.0:1788752791.389661:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752791.389725:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009635be1 going to sleep for 11 seconds 00000100:00100000:2.0:1788752791.389765:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614784 00000100:00100000:2.0:1788752791.389770:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614784 00000100:00100000:2.0:1788752791.389836:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788752791.389845:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031941230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5814:x1875643182614784:12345-0@lo:503: 00000100:00100000:2.0:1788752791.390618:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031941230 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5814:x1875643182614784:12345-0@lo:503: Request processed in 773us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752791.390627:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788752791.390704:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182614784:0@lo:503: 00000100:00100000:3.0:1788752791.391086:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5861:1875643182614912:0@lo:502: 00000100:00100000:3.0:1788752791.391285:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752791.391313:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e67e8df going to sleep for 11 seconds 00000100:00100000:0.0:1788752791.391353:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182614912 00000100:00100000:0.0:1788752791.391359:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182614912 00000100:00100000:0.0:1788752791.391474:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788752791.391482:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000ff06f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5861:x1875643182614912:12345-0@lo:502: 00000100:00100000:0.0:1788752791.391745:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000ff06f26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5861:x1875643182614912:12345-0@lo:502: Request processed in 264us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752791.391770:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788752791.391843:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ad670e4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5861:1875643182614912:0@lo:502: 00000020:01000004:2.0:1788752791.391901:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788752791.391914:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dc15a18f) 00000020:00000080:2.0:1788752791.391932:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788752791.392077:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000edceb8a2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788752791.392081:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000edceb8a2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788752791.392084:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000edceb8a2 4 00010000:00080000:2.0:1788752791.392113:0:5861:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000e594d4fc@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:2.0:1788752791.394603:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788752791.394889:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788752791.394922:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788752791.394936:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x80c8383f4848fb52 00000100:00080000:2.0:1788752791.394946:0:5861:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788752791.395014:0:5861:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e594d4fc using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1788752791.395050:0:5861:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c0d71f54 x1875643182615040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788752791.395088:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788752791.395419:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0d71f54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182615040:0@lo:38: 00000100:00100000:3.0:1788752791.395484:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752791.395604:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615040 00000100:00100000:2.0:1788752791.395611:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615040 00000100:00100000:2.0:1788752791.395651:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788752791.395657:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014cc24f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875643182615040:12345-0@lo:38: 00000100:00100000:2.0:1788752791.395709:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014cc24f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875643182615040:12345-0@lo:38: Request processed in 51us (225us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788752791.395716:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788752791.395751:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788752791.395768:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000e594d4fc lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788752791.395772:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788752791.395775:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0d71f54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182615040:0@lo:38: 00000100:00100000:2.0:1788752791.395846:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c0d71f54 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5861:1875643182615168:0@lo:502: 00000100:00100000:2.0:1788752791.395885:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752791.395907:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615168 00000100:00100000:2.0:1788752791.395911:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615168 00000100:00100000:2.0:1788752791.395937:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788752791.395942:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000107949b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5861:x1875643182615168:12345-0@lo:502: 00000100:00100000:3.0:1788752791.397338:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b86e869d going to sleep for 11 seconds 00000100:00100000:2.0:1788752791.397674:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000107949b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5861:x1875643182615168:12345-0@lo:502: Request processed in 1730us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752791.397683:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788752791.397824:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c0d71f54 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:5861:1875643182615168:0@lo:502: 00000040:00080000:3.0:1788752791.397864:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788752791.402086:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788752791.402140:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788752791.402159:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 0000000058fbb0fe/0x80c8383f4848fb3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752791.402185:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 0000000058fbb0fe/0x80c8383f4848fb3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788752791.402238:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788752791.402240:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788752791.402242:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788752791.402243:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788752791.402245:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788752791.402246:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788752791.402247:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788752791.402249:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788752791.402250:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788752791.402252:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788752791.402253:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788752791.402255:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788752791.402258:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788752791.402261:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788752791.402262:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788752791.402264:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788752791.402265:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788752791.402266:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788752791.402267:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788752791.402268:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788752791.402269:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788752791.402270:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788752791.402271:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788752791.402271:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788752791.402272:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788752791.402298:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788752791.402316:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb4e3bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182615296:0@lo:253: 00000100:00100000:2.0:1788752791.402406:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752791.402446:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d6b4230 going to sleep for 11 seconds 00000100:00100000:0.0:1788752791.405101:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615296 00000100:00100000:0.0:1788752791.405115:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615296 00000100:00100000:0.0:1788752791.405837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788752791.405847:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000265eb438 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5814:x1875643182615296:12345-0@lo:253: 20000000:01000000:0.0:1788752791.405882:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788752791.405894:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788752791.443819:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788752791.443837:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788752791.443884:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788752791.443890:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788752791.443909:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752791.443926:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752791.443949:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752791.443986:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752791.443999:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 12 pid: 5825 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752791.444013:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000203d5751 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875643182615424:0@lo:104: 00000100:00100000:3.0:1788752791.444083:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752791.444161:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a44e62d3 going to sleep for 11 seconds 00000100:00100000:0.0:1788752791.444296:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615424 00000100:00100000:0.0:1788752791.444304:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615424 00000100:00100000:0.0:1788752791.444352:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788752791.444360:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000012d3904c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5849:x1875643182615424:12345-0@lo:104: 00010000:00010000:0.0:1788752791.444372:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444437:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788752791.444442:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000012d3904c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5849:x1875643182615424:12345-0@lo:104: Request processed in 84us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752791.444449:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788752791.444494:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000203d5751 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875643182615424:0@lo:104: 00010000:00010000:0.0:1788752791.444517:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444532:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752791.444537:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444554:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cbc8bd04 already unused, calling callback (00000000c5b3d3cc) 10000000:00010000:0.0:1788752791.444557:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444564:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752791.444570:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752791.444575:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752791.444602:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444608:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752791.444623:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444629:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: 00000000cbc8bd04/0x80c8383f4848fb21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb28 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444645:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752791.444646:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752791.444648:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752791.444704:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000194a9f68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182615552:0@lo:103: 00000100:00100000:0.0:1788752791.444731:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752791.444806:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615552 00000100:00100000:0.0:1788752791.444811:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615552 00010000:00010000:0.0:1788752791.444826:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 13 pid: 5825 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752791.444856:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788752791.444864:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bef16874 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3304:x1875643182615552:12345-0@lo:103: 00010000:00010000:0.0:1788752791.444874:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752791.444878:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 13 pid: 5825 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444886:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 13 pid: 5825 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444897:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fb21 expref: 13 pid: 5825 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444908:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444914:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788752791.444927:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001038441s 00010000:00010000:0.0:1788752791.444930:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444936:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444941:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444945:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444956:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000615ea0bf already unused, calling callback (00000000378590ea) 00010000:00010000:0.0:1788752791.444959:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444965:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444977:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.444985:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752791.445013:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bef16874 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:3304:x1875643182615552:12345-0@lo:103: Request processed in 153us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752791.445019:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788752791.445038:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.445044:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752791.445058:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000615ea0bf/0x80c8383f4848fb59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752791.445082:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000194a9f68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182615552:0@lo:103: 00000100:00100000:3.0:1788752791.456169:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000265eb438 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5814:x1875643182615296:12345-0@lo:253: Request processed in 50315us (53755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752791.456191:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788752791.456325:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb4e3bf0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:5814:1875643182615296:0@lo:253: 10000000:01000000:2.0:1788752791.456344:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788752791.456364:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788752791.456366:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788752791.456367:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788752791.456368:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788752791.456369:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788752791.456370:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788752791.456371:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788752791.456373:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788752791.456374:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788752791.456375:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788752791.456377:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788752791.456378:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788752791.456454:0:5814:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788752791.463072:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788752791.466229:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00010000:00010000:1.0:1788752791.466493:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788752791.471845:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788752791.473283:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788752791.474019:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788752791.475987:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788752791.480043:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788752791.480271:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788752791.480467:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788752791.481051:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788752791.481285:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788752791.484819:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788752791.597797:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788752791.658275:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788752791.658338:0:5866:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788752791.658341:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788752791.659116:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788752791.663942:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788752791.664287:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788752791.665139:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788752791.665150:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788752791.665322:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788752791.666656:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788752791.667390:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788752791.667423:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788752791.667711:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788752791.669445:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788752791.674117:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788752791.674390:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788752791.674653:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788752791.677010:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788752791.677588:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788752791.678243:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788752791.678352:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788752791.678901:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788752791.682331:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788752791.682678:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788752791.682970:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788752791.683361:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788752791.683592:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788752791.692728:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788752791.694395:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788752791.694721:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788752791.695729:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788752791.696421:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788752791.702049:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788752791.703216:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788752791.703358:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788752791.704273:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788752791.704501:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788752791.704777:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788752791.705015:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788752791.705267:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788752791.705483:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788752791.705736:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788752791.706020:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788752791.706288:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788752791.707392:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788752791.708920:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788752791.713394:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788752791.721677:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1788752791.763610:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788752791.763648:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab8a01c7b988 00100000:10000000:2.0:1788752791.763658:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788752791.767978:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788752791.767996:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788752791.768008:0:5814:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788752791.768023:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788752791.811920:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788752791.811993:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788752791.811997:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788752792.494692:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752793.516250:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752794.541349:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752795.562279:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788752796.377009:0:6110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788752796.587937:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788752796.843221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788752796.843231:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788752796.843233:0:36:0:(import.c:65:import_set_state_nolock()) 00000000e594d4fc lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788752796.843259:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e594d4fc using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1788752796.843279:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000024902284 x1875643182615808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788752796.843421:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788752796.843434:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000928be4c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182615680:0@lo:400: 00000100:00100000:3.0:1788752796.843499:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752796.843602:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182615808:0@lo:38: 00000100:00100000:3.0:1788752796.843631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752796.843667:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615808 00000100:00100000:3.0:1788752796.843675:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615808 00000100:00100000:3.0:1788752796.843703:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788752796.843709:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000325803da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875643182615808:12345-0@lo:38: 00010000:00080000:3.0:1788752796.843744:0:5835:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1788752796.843778:0:5835:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x80c8383f4848fb60 00000004:00100000:3.0:1788752796.843858:0:5835:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788752796.843973:0:5835:0:(import.c:65:import_set_state_nolock()) 000000003b06290b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752796.844023:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000325803da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875643182615808:12345-0@lo:38: Request processed in 313us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752796.844030:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788752796.844068:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000024902284 x1875643182615808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788752806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788752796.844083:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788752796.844090:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788752796.844095:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788752796.844098:0:3302:0:(import.c:65:import_set_state_nolock()) 00000000e594d4fc lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788752796.844103:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182615808:0@lo:38: 00000100:00100000:3.0:1788752796.844162:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615680 00000100:00100000:3.0:1788752796.844166:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615680 00000100:00100000:3.0:1788752796.844193:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788752796.844199:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009dd86fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+11:3306:x1875643182615680:12345-0@lo:400: 00000100:00100000:3.0:1788752796.844233:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009dd86fd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+11:3306:x1875643182615680:12345-0@lo:400: Request processed in 35us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752796.844239:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788752796.844270:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000928be4c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182615680:0@lo:400: 10000000:01000000:2.0:1788752797.360914:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788752797.360922:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9b90a5a800 from 3 10000000:01000000:2.0:1788752797.360928:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788752797.360977:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000aa6c918f/0x80c8383f4848fb67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752797.360990:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000aa6c918f/0x80c8383f4848fb67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752797.361001:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000aa6c918f/0x80c8383f4848fb67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752797.361726:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb4e3bf0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182615936:0@lo:101: 00000100:00100000:2.0:1788752797.362923:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752797.362983:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000002bf42d93 going to sleep for 11 seconds 00000100:00100000:0.0:1788752797.364107:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182615936 00000100:00100000:0.0:1788752797.364438:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182615936 00000100:00100000:0.0:1788752797.364498:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788752797.364511:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fb55bfc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5829:x1875643182615936:12345-0@lo:101: 00010000:00010000:0.0:1788752797.364529:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752797.364547:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008096812d/0x80c8383f4848fb6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fb67 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752797.364577:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008096812d/0x80c8383f4848fb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752797.364587:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008096812d/0x80c8383f4848fb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752797.364596:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008096812d, rc 0) 00000100:00100000:0.0:1788752797.367271:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fb55bfc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182615936:12345-0@lo:101: Request processed in 2754us (4345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752797.367284:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788752797.370921:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb4e3bf0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182615936:0@lo:101: 00010000:00010000:1.0:1788752797.370951:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000aa6c918f/0x80c8383f4848fb67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752797.370962:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000aa6c918f/0x80c8383f4848fb67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752797.372215:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616064:0@lo:256: 00000100:00100000:1.0:1788752797.372285:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752797.372343:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 0000000015d48eae going to sleep for 11 seconds 00000100:00100000:2.0:1788752797.374589:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616064 00000100:00100000:2.0:1788752797.374622:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616064 00000100:00100000:2.0:1788752797.374684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788752797.374692:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000028fd12d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182616064:12345-0@lo:256: 20000000:01000000:2.0:1788752797.374725:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788752797.374741:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788752797.374744:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788752797.374860:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000028fd12d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182616064:12345-0@lo:256: Request processed in 169us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752797.374868:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788752797.375341:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616064:0@lo:256: 10000000:01000000:1.0:1788752797.375413:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788752797.375423:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: 00000000aa6c918f/0x80c8383f4848fb67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752797.375445:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: 00000000aa6c918f/0x80c8383f4848fb67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752797.610429:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752798.634873:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752799.658707:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752800.683327:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788752800.923560:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd38c07e50 20000000:00000080:2.0:1788752800.923576:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c9ba0124c00 uarg=0000000000000000 20000000:01000000:2.0:1788752800.923604:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788752800.923611:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788752800.923614:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788752800.924001:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788752800.924013:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788752800.930761:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788752800.931045:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788752800.931101:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788752800.931169:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788752800.931187:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788752800.931206:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752800.931223:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752800.931231:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752800.931532:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752800.931547:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 11 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752800.931559:0:6311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc067a41 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875643182616192:0@lo:104: 00000100:00100000:2.0:1788752800.931618:0:6311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752800.931764:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616192 00000100:00100000:0.0:1788752800.931774:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616192 00000100:00100000:0.0:1788752800.931814:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788752800.931822:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ad5048d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:6311:x1875643182616192:12345-0@lo:104: 00010000:00010000:0.0:1788752800.931833:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752800.931884:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788752800.931889:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ad5048d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:6311:x1875643182616192:12345-0@lo:104: Request processed in 69us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752800.931906:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752800.931999:0:6311:0:(client.c:2716:ptlrpc_set_wait()) set 0000000028e09ab2 going to sleep for 11 seconds 00000100:00100000:2.0:1788752800.932022:0:6311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc067a41 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875643182616192:0@lo:104: 00010000:00010000:2.0:1788752800.932039:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.934932:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788752800.934942:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.934955:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a531a367 already unused, calling callback (00000000c5b3d3cc) 10000000:00010000:3.0:1788752800.934958:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.934967:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788752800.934974:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752800.934980:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788752800.935030:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935036:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788752800.935064:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935083:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: 00000000a531a367/0x80c8383f4848fb2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb36 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935099:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752800.935109:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752800.935111:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752800.935173:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000928be4c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182616320:0@lo:103: 00000100:00100000:0.0:1788752800.935234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752800.935596:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616320 00000100:00100000:3.0:1788752800.935604:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616320 00010000:00010000:3.0:1788752800.935633:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 12 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752800.935670:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788752800.935678:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000194a9f68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:3306:x1875643182616320:12345-0@lo:103: 00010000:00010000:3.0:1788752800.935820:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752800.935826:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 12 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935837:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 12 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935851:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001d4d0998/0x80c8383f4848fb36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fb2f expref: 12 pid: 5826 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935866:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935873:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935899:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935906:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935912:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935917:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935923:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002506ad72 already unused, calling callback (00000000378590ea) 00010000:00010000:3.0:1788752800.935926:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.935932:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752800.940216:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752800.940234:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.941740:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.941755:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002506ad72/0x80c8383f4848fb75 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752800.941777:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752800.941865:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000194a9f68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:3306:x1875643182616320:12345-0@lo:103: Request processed in 6184us (6627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752800.941874:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752800.942024:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000928be4c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182616320:0@lo:103: 00010000:00010000:2.0:1788752801.725850:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752801.965842:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182616448:0@lo:400: 00000100:00100000:1.0:1788752801.965911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752801.965981:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752801.965987:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090f30634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182616576:0@lo:400: 00000100:00100000:1.0:1788752801.966015:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752801.966046:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616448 00000100:00100000:1.0:1788752801.966053:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616448 00000100:00100000:1.0:1788752801.966094:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788752801.966101:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f198b59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:3303:x1875643182616448:12345-0@lo:400: 00000100:00100000:1.0:1788752801.966160:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f198b59f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:3303:x1875643182616448:12345-0@lo:400: Request processed in 60us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752801.966166:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788752801.966199:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616576 00000100:00100000:1.0:1788752801.966202:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616576 00000100:00100000:1.0:1788752801.966226:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788752801.966232:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005df7c168 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182616576:12345-0@lo:400: 00000100:00100000:1.0:1788752801.966262:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005df7c168 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182616576:12345-0@lo:400: Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752801.966268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788752801.966298:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000090f30634 x1875643182616576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752801.966311:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090f30634 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182616576:0@lo:400: 00000100:00100000:1.0:1788752801.966335:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002a134120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182616448:0@lo:400: 00010000:00010000:3.0:1788752802.730699:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788752803.242416:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788752803.242425:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9b90a5a800 from 1 10000000:01000000:3.0:1788752803.242430:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788752803.242475:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: 00000000e6c5826c/0x80c8383f4848fb7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752803.242487:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: 00000000e6c5826c/0x80c8383f4848fb7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752803.242497:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: 00000000e6c5826c/0x80c8383f4848fb7c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752803.242518:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616704:0@lo:101: 00000100:00100000:3.0:1788752803.242582:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752803.242637:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ceb4c51 going to sleep for 11 seconds 00000100:00100000:0.0:1788752803.242748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616704 00000100:00100000:0.0:1788752803.242756:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616704 00000100:00100000:0.0:1788752803.242813:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788752803.242821:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d7ff7e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+11:5829:x1875643182616704:12345-0@lo:101: 00010000:00010000:0.0:1788752803.242834:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752803.242846:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fb7c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752803.242866:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752803.242876:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000922ad32b/0x80c8383f4848fb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752803.242885:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000922ad32b, rc 0) 00000100:00100000:0.0:1788752803.242930:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d7ff7e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182616704:12345-0@lo:101: Request processed in 109us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752803.242936:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788752803.243106:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616704:0@lo:101: 00010000:00010000:3.0:1788752803.243137:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: 00000000e6c5826c/0x80c8383f4848fb7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752803.243147:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: 00000000e6c5826c/0x80c8383f4848fb7c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752803.243199:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616832:0@lo:501: 00000100:00100000:3.0:1788752803.243224:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752803.243253:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ceb4c51 going to sleep for 11 seconds 00000100:00100000:1.0:1788752803.243318:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616832 00000100:00100000:1.0:1788752803.243324:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616832 00000100:00100000:1.0:1788752803.243354:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788752803.243360:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a62a7a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182616832:12345-0@lo:501: 00000100:00100000:1.0:1788752803.243595:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a62a7a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182616832:12345-0@lo:501: Request processed in 235us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752803.243603:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788752803.243780:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616832:0@lo:501: 00000100:00100000:3.0:1788752803.243809:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616960:0@lo:503: 00000100:00100000:3.0:1788752803.243848:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752803.243876:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ceb4c51 going to sleep for 11 seconds 00000100:00100000:1.0:1788752803.243926:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182616960 00000100:00100000:1.0:1788752803.243932:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182616960 00000100:00100000:1.0:1788752803.243967:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788752803.243973:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000272b510c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182616960:12345-0@lo:503: 00000100:00100000:1.0:1788752803.244150:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000272b510c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182616960:12345-0@lo:503: Request processed in 177us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752803.244157:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788752803.244193:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024902284 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182616960:0@lo:503: 00000100:00100000:3.0:1788752803.244987:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc41beb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6473:1875643182617088:0@lo:502: 00000100:00100000:3.0:1788752803.245174:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752803.245206:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set 00000000471c449b going to sleep for 11 seconds 00000100:00100000:0.0:1788752803.245753:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617088 00000100:00100000:0.0:1788752803.245760:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617088 00000100:00100000:0.0:1788752803.245800:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788752803.245807:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000006647bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6473:x1875643182617088:12345-0@lo:502: 00000100:00100000:0.0:1788752803.246109:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000006647bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6473:x1875643182617088:12345-0@lo:502: Request processed in 302us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752803.246154:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788752803.246253:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc41beb6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6473:1875643182617088:0@lo:502: 00000020:01000000:3.0:1788752803.246284:0:6473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752803.246292:0:6473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752803.246295:0:6473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788752803.246303:0:6473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9b90a5a800 00000020:00000080:3.0:1788752803.246628:0:6473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788752803.246685:0:6473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6473:1875643182617216:0@lo:502: 00000100:00100000:3.0:1788752803.246726:0:6473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752803.246757:0:6473:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b86f71240 going to sleep for 11 seconds 00000100:00100000:1.0:1788752803.247244:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617216 00000100:00100000:1.0:1788752803.247252:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617216 00000100:00100000:1.0:1788752803.247292:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788752803.247300:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6473:x1875643182617216:12345-0@lo:502: 00000100:00100000:1.0:1788752803.247654:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6473:x1875643182617216:12345-0@lo:502: Request processed in 353us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752803.247662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788752803.247843:0:6473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6473:1875643182617216:0@lo:502: 00000020:01000000:3.0:1788752803.247868:0:6473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752803.247874:0:6473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752803.247876:0:6473:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788752803.247881:0:6473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788752803.248232:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788752803.248255:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788752803.248263:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752803.248275:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752803.756935:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752804.782775:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752805.802440:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788752806.314108:0:6686:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788752806.314113:0:6686:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788752806.314264:0:6686:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c9bbd907800 00000020:01000004:0.0:1788752806.314279:0:6686:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788752806.314361:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788752806.314377:0:6686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c9b8731cd40) 00000020:00000080:0.0:1788752806.314392:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788752806.327266:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788752806.327594:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788752806.345035:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788752806.349986:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788752806.350015:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788752806.350210:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788752806.350236:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788752806.350647:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788752806.350668:0:6686:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788752806.350679:0:6686:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x80c8383f4848fb91 00000020:01000004:0.0:1788752806.350689:0:6686:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788752806.350710:0:6686:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788752806.350713:0:6686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788752806.350719:0:6686:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788752806.350730:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788752806.350742:0:6686:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c9b87318000) 00000020:00000080:0.0:1788752806.350751:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788752806.352030:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788752806.352497:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788752806.352503:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788752806.353317:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788752806.353325:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788752806.353597:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788752806.353608:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788752806.355511:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788752806.355706:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788752806.355712:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788752806.356780:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788752806.356787:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788752806.373001:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788752806.373503:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788752806.373510:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788752806.375509:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788752806.375523:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788752806.376629:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788752806.376639:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788752806.379056:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788752806.379395:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788752806.379402:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788752806.380111:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788752806.380119:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788752806.425357:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788752806.425556:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788752806.425563:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788752806.429648:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788752806.429682:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788752806.435209:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788752806.435234:0:6686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788752806.435240:0:6686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788752806.468735:0:6686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788752806.468775:0:6686:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788752806.468779:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788752806.468781:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788752806.468783:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788752806.468784:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788752806.468785:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788752806.468786:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788752806.468788:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788752806.468789:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788752806.468791:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788752806.468793:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788752806.468794:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788752806.468798:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788752806.468800:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788752806.468801:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788752806.468803:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788752806.468804:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788752806.468805:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788752806.468806:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788752806.468807:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788752806.468809:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788752806.468810:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788752806.468811:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788752806.468812:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788752806.468837:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788752806.468854:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182617344:0@lo:253: 00000100:00100000:2.0:1788752806.469018:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752806.469167:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788752806.469404:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617344 00000100:00100000:0.0:1788752806.469412:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617344 00000100:00100000:0.0:1788752806.469465:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788752806.469474:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182617344:12345-0@lo:253: 20000000:01000000:0.0:1788752806.469514:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788752806.469518:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788752806.469523:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788752806.469526:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788752806.471043:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788752806.471540:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788752806.471555:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788752806.471595:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788752806.471609:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788752806.471642:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788752806.471702:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788752806.472117:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788752806.472378:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:0.0:1788752806.472380:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:0.0:1788752806.472419:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788752806.472426:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788752806.472471:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788752806.472480:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:0.0:1788752806.472507:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788752806.472516:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788752806.472544:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788752806.472605:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788752806.474083:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788752806.474109:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:0.0:1788752806.474111:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:0.0:1788752806.474429:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788752806.474438:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788752806.474464:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788752806.474470:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:0.0:1788752806.474508:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788752806.474516:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788752806.474542:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788752806.474573:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788752806.474590:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788752806.474592:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788752806.474598:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788752806.474600:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788752806.474602:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788752806.474615:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788752806.474626:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788752806.474669:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788752806.474672:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788752806.475516:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788752806.475583:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788752806.475631:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788752806.476034:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788752806.476073:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788752806.477514:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788752806.477541:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788752806.477543:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788752806.478396:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788752806.478463:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788752806.478516:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788752806.478946:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788752806.478988:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788752806.479025:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788752806.479037:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788752806.479039:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788752806.479531:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788752806.479759:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788752806.479946:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788752806.480027:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788752806.480045:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788752806.480062:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480078:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b80031600/0x80c8383f4848fab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480085:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848facd expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480092:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85928c00/0x80c8383f4848fb44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480100:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480374:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85928c00/0x80c8383f4848fb44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480390:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b85928c00/0x80c8383f4848fb44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 12 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.480405:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875643182617472:0@lo:104: 00000100:00100000:0.0:1788752806.480464:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788752806.480563:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848facd expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480572:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848facd expref: 12 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.480580:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875643182617600:0@lo:104: 00000100:00100000:0.0:1788752806.480601:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788752806.480711:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b80031600/0x80c8383f4848fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.480719:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b80031600/0x80c8383f4848fab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 12 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.480728:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875643182617728:0@lo:104: 00000100:00100000:0.0:1788752806.480748:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.481038:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617472 00000100:00100000:3.0:1788752806.481045:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617472 00000100:00100000:3.0:1788752806.481082:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617600 00000100:00100000:3.0:1788752806.481085:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617600 00000100:00100000:3.0:1788752806.481100:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788752806.481109:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:5826:x1875643182617472:12345-0@lo:104: 00010000:00010000:3.0:1788752806.481139:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481203:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788752806.481210:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:5826:x1875643182617472:12345-0@lo:104: Request processed in 103us (747us total) trans 0 rc 0/0 00010000:00010000:2.0:1788752806.481261:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788752806.481268:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.481276:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173a00 already unused, calling callback (ffffffffc1b05c20) 00000100:00100000:3.0:1788752806.481284:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:2.0:1788752806.481286:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.481295:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788752806.481302:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752806.481307:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788752806.481341:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.481348:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788752806.481357:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788752806.481364:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5826:x1875643182617600:12345-0@lo:104: 00010000:00010000:2.0:1788752806.481365:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481372:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.481372:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fb3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb44 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481406:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788752806.481411:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5826:x1875643182617600:12345-0@lo:104: Request processed in 48us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752806.481416:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788752806.481432:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788752806.481466:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752806.481468:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752806.481470:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752806.481482:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182617856:0@lo:103: 00000100:00100000:2.0:1788752806.481509:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788752806.481550:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752806.481555:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481562:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2da00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788752806.481565:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481572:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788752806.481578:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752806.481593:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788752806.481608:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481614:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788752806.481634:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481641:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848facd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fad4 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.481650:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752806.481660:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752806.481662:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752806.481669:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788752806.481676:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182617984:0@lo:103: 00000100:00100000:3.0:1788752806.481699:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788752806.481720:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752806.481722:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752806.481845:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617856 00000100:00100000:0.0:1788752806.481850:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617856 00010000:00010000:0.0:1788752806.481869:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85928c00/0x80c8383f4848fb44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 13 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.481909:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617984 00000100:00100000:0.0:1788752806.481913:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617984 00010000:00010000:0.0:1788752806.481924:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fad4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848facd expref: 14 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.481935:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788752806.481941:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3305:x1875643182617856:12345-0@lo:103: 00010000:00010000:0.0:1788752806.481950:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752806.481955:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85928c00/0x80c8383f4848fb44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 14 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.481965:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85928c00/0x80c8383f4848fb44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 14 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.481980:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752806.482010:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3305:x1875643182617856:12345-0@lo:103: Request processed in 69us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752806.482016:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788752806.482027:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788752806.482032:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3305:x1875643182617984:12345-0@lo:103: 00010000:00010000:0.0:1788752806.482038:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752806.482041:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fad4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848facd expref: 13 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482049:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848facd expref: 13 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482056:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752806.482081:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3305:x1875643182617984:12345-0@lo:103: Request processed in 49us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752806.482087:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788752806.482116:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182617984:0@lo:103: 00000100:00100000:0.0:1788752806.482151:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182617856:0@lo:103: 00000100:00100000:2.0:1788752806.482194:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812f900 going to sleep for 11 seconds 00010000:00010000:2.0:1788752806.482211:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928c00/0x80c8383f4848fb44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fb3d expref: 12 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.482221:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875643182617472:0@lo:104: 00010000:00010000:2.0:1788752806.482230:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848facd expref: 11 pid: 5827 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.482247:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875643182617600:0@lo:104: 00000100:00100000:3.0:1788752806.482336:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182617728 00000100:00100000:3.0:1788752806.482340:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182617728 00000100:00100000:3.0:1788752806.482359:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788752806.482365:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5826:x1875643182617728:12345-0@lo:104: 00010000:00010000:3.0:1788752806.482374:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.482423:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788752806.482428:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5826:x1875643182617728:12345-0@lo:104: Request processed in 64us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752806.482439:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788752806.482478:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5826:1875643182617728:0@lo:104: 00010000:00010000:2.0:1788752806.482496:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482533:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752806.482538:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482545:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752806.482548:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482556:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752806.482563:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752806.482568:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752806.482597:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482603:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752806.482628:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.482635:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182618112:0@lo:103: 00010000:00010000:0.0:1788752806.482635:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fab8 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482668:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752806.482670:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752806.482672:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752806.482673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752806.482691:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182618112 00000100:00100000:0.0:1788752806.482695:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182618112 00010000:00010000:0.0:1788752806.482709:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b80031600/0x80c8383f4848fab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 11 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.482732:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788752806.482738:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+11:3303:x1875643182618112:12345-0@lo:103: 00010000:00010000:0.0:1788752806.482747:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752806.482751:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b80031600/0x80c8383f4848fab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 11 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482760:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b80031600/0x80c8383f4848fab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 11 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482770:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b80031600/0x80c8383f4848fab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fab1 expref: 11 pid: 5826 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482783:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482801:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482814:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482821:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482831:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482838:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482843:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752806.482846:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482854:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482872:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.482880:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752806.482907:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+10:3303:x1875643182618112:12345-0@lo:103: Request processed in 169us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752806.482913:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788752806.482934:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182618112:0@lo:103: 00010000:00010000:2.0:1788752806.483353:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.483362:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.483368:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8000/0x80c8383f4848fb9f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788752806.483381:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788752806.537707:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+9:6686:x1875643182617344:12345-0@lo:253: Request processed in 68225us (68680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752806.537722:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788752806.537829:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182617344:0@lo:253: 10000000:01000000:1.0:1788752806.537844:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788752806.537848:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788752806.537849:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788752806.537850:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788752806.537852:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788752806.537854:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788752806.537855:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788752806.537857:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788752806.537859:0:6686:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788752806.537860:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788752806.537861:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788752806.537880:0:6686:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c9bbd907800 from lustre-OST0000 10000000:01000000:1.0:1788752806.537904:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788752806.537907:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788752806.537914:0:6686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c9b8731b380 local copy 10000000:01000000:1.0:1788752806.537918:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788752806.537955:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.537967:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.537975:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752806.537993:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618240:0@lo:101: 00000100:00100000:1.0:1788752806.538040:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752806.538141:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0ed5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788752806.538194:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182618240 00000100:00100000:3.0:1788752806.538201:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182618240 00000100:00100000:3.0:1788752806.538238:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788752806.538246:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+9:6686:x1875643182618240:12345-0@lo:101: 00010000:00010000:3.0:1788752806.538258:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752806.538270:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2da00/0x80c8383f4848fbad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fba6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.538301:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2da00/0x80c8383f4848fbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fba6 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.538311:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2da00/0x80c8383f4848fbad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fba6 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.538319:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2da00, rc 0) 00000100:00100000:3.0:1788752806.538348:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+10:6686:x1875643182618240:12345-0@lo:101: Request processed in 103us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752806.538354:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788752806.538607:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618240:0@lo:101: 00010000:00010000:2.0:1788752806.538621:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.538629:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.538738:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618368:0@lo:501: 00000100:00100000:2.0:1788752806.538765:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752806.538826:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752806.538858:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182618368 00000100:00100000:3.0:1788752806.538863:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182618368 00000100:00100000:3.0:1788752806.538922:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788752806.538929:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+10:6686:x1875643182618368:12345-0@lo:501: 00000100:00100000:3.0:1788752806.539187:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+10:6686:x1875643182618368:12345-0@lo:501: Request processed in 258us (420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788752806.539195:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788752806.539355:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618368:0@lo:501: 10000000:01000000:2.0:1788752806.539369:0:6686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788752806.539473:0:6686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788752806.539480:0:6686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.539487:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.539494:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.539547:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788752806.539564:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c9bbd907800 10000000:01000000:2.0:1788752806.539569:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788752806.539573:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c9b8731b380 10000000:01000000:2.0:1788752806.539576:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788752806.539580:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c9b8731b380 from 1 10000000:01000000:2.0:1788752806.539583:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788752806.539607:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.539614:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.539633:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.539646:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618496:0@lo:101: 00000100:00100000:2.0:1788752806.539686:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752806.539714:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.539768:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182618496 00000100:00100000:1.0:1788752806.539773:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182618496 00000100:00100000:1.0:1788752806.539811:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788752806.539818:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+10:6686:x1875643182618496:12345-0@lo:101: 00010000:00010000:1.0:1788752806.539828:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752806.539838:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2172a00/0x80c8383f4848fbbb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fbb4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.539853:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2172a00/0x80c8383f4848fbbb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fbb4 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.539862:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2172a00/0x80c8383f4848fbbb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fbb4 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.539870:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2172a00, rc 0) 00000100:00100000:1.0:1788752806.539895:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:6686:x1875643182618496:12345-0@lo:101: Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.539901:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788752806.539981:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618496:0@lo:101: 00010000:00010000:2.0:1788752806.539993:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbbb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.540001:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fbbb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752806.540016:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788752806.540032:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbbb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.540039:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbbb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752806.540046:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788752806.540050:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788752806.540054:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788752806.540056:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788752806.540069:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.540075:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.540088:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.540099:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618624:0@lo:101: 00000100:00100000:2.0:1788752806.540143:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752806.540155:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.540213:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182618624 00000100:00100000:1.0:1788752806.540218:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182618624 00000100:00100000:1.0:1788752806.540244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788752806.540250:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:6686:x1875643182618624:12345-0@lo:101: 00010000:00010000:1.0:1788752806.540257:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752806.540264:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fbc2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.540277:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.540303:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.540310:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2172400, rc 0) 00000100:00100000:1.0:1788752806.540337:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182618624:12345-0@lo:101: Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.540342:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788752806.540517:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618624:0@lo:101: 00010000:00010000:2.0:1788752806.540528:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.540535:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.540601:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618752:0@lo:501: 00000100:00100000:2.0:1788752806.540627:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752806.540664:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.540716:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182618752 00000100:00100000:1.0:1788752806.540720:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182618752 00000100:00100000:1.0:1788752806.540748:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788752806.540754:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182618752:12345-0@lo:501: 00000100:00100000:1.0:1788752806.540957:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182618752:12345-0@lo:501: Request processed in 203us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.540963:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788752806.541039:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618752:0@lo:501: 00000100:00100000:2.0:1788752806.541064:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618880:0@lo:503: 00000100:00100000:2.0:1788752806.541100:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752806.541118:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752806.541202:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182618880 00000100:00100000:3.0:1788752806.541207:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182618880 00000100:00100000:3.0:1788752806.541235:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788752806.541241:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182618880:12345-0@lo:503: 00000100:00100000:3.0:1788752806.541620:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182618880:12345-0@lo:503: Request processed in 378us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752806.541628:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788752806.541716:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752806.541723:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.541730:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752806.541734:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.541753:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752806.541760:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752806.541764:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752806.541784:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.541790:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752806.541815:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.541821:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x80c8383f4848fbad expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.541834:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752806.541836:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752806.541838:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752806.541878:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182619008:0@lo:103: 00000100:00100000:3.0:1788752806.541904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752806.541974:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619008 00000100:00100000:0.0:1788752806.541979:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619008 00000100:00100000:0.0:1788752806.542014:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788752806.542020:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:3304:x1875643182619008:12345-0@lo:103: 00010000:00010000:0.0:1788752806.542029:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752806.542040:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2da00/0x80c8383f4848fbad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fba6 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.542050:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752806.542086:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe552d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:3304:x1875643182619008:12345-0@lo:103: Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752806.542092:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788752806.542166:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182619008:0@lo:103: 00000100:00100000:2.0:1788752806.542479:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182618880:0@lo:503: 00000040:00080000:3.0:1788752806.542849:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788752806.542915:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619136:0@lo:502: 00000100:00100000:3.0:1788752806.542954:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.543023:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788752806.543060:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619136 00000100:00100000:2.0:1788752806.543065:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619136 00000100:00100000:2.0:1788752806.543154:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788752806.543162:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+11:6686:x1875643182619136:12345-0@lo:502: 00000100:00100000:2.0:1788752806.543479:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+11:6686:x1875643182619136:12345-0@lo:502: Request processed in 318us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752806.543486:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788752806.543557:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619136:0@lo:502: 00000040:00080000:3.0:1788752806.543792:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788752806.543834:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788752806.543861:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788752806.543898:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788752806.543925:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788752806.543949:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788752806.543970:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619264:0@lo:502: 00000100:00100000:3.0:1788752806.544003:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.544139:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.544300:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619264 00000100:00100000:1.0:1788752806.544306:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619264 00000100:00100000:1.0:1788752806.544331:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788752806.544338:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:6686:x1875643182619264:12345-0@lo:502: 00000100:00100000:1.0:1788752806.544485:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:6686:x1875643182619264:12345-0@lo:502: Request processed in 147us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.544492:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788752806.544621:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619264:0@lo:502: 00000040:00080000:3.0:1788752806.544709:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788752806.544718:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788752806.545228:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788752806.545240:0:6705:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788752806.545246:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752806.545248:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788752806.545252:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788752806.545265:0:6705:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c9bbe5619c0) 00000020:00000080:3.0:1788752806.545282:0:6705:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788752806.545297:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788752806.545353:0:6705:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bbd907800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788752806.545360:0:6705:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788752806.545366:0:6705:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x80c8383f4848fbd7 00010000:00010000:3.0:1788752806.549483:0:6705:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788752806.549740:0:6705:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788752806.552088:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788752806.552620:0:6705:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788752806.559759:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788752806.560253:0:6705:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788752806.561663:0:6705:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788752806.561673:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752806.561679:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752806.561681:0:6705:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788752806.561684:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752806.561688:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752806.561689:0:6705:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788752806.561692:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788752806.561694:0:6705:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788752806.561742:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752806.561745:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752806.561747:0:6705:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788752806.561751:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788752806.564148:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788752806.564182:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788752806.564201:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.564213:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752806.564222:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbd907800 from 1 10000000:01000000:0.0:1788752806.564225:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788752806.564261:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.564270:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.564282:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.564318:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619392:0@lo:101: 00000100:00100000:0.0:1788752806.564511:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752806.564611:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb251ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752806.565201:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619392 00000100:00100000:2.0:1788752806.565211:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619392 00000100:00100000:2.0:1788752806.565295:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788752806.565304:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:6686:x1875643182619392:12345-0@lo:101: 00010000:00010000:2.0:1788752806.565319:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752806.565334:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fbde expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.565358:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fbde expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.565369:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fbde expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.565376:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928a00, rc 0) 00000100:00100000:2.0:1788752806.566937:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619392:12345-0@lo:101: Request processed in 1628us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752806.566949:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788752806.567497:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619392:0@lo:101: 00010000:00010000:0.0:1788752806.567521:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.567533:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752806.567665:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619520:0@lo:501: 00000100:00100000:0.0:1788752806.567706:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752806.571217:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb251ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.571557:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619520 00000100:00100000:1.0:1788752806.571567:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619520 00000100:00100000:1.0:1788752806.571609:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788752806.571619:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619520:12345-0@lo:501: 00000100:00100000:1.0:1788752806.571899:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619520:12345-0@lo:501: Request processed in 281us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.571914:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788752806.572018:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619520:0@lo:501: 00000100:00100000:0.0:1788752806.572062:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619648:0@lo:503: 00000100:00100000:0.0:1788752806.572105:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752806.572152:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb251ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.572210:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619648 00000100:00100000:1.0:1788752806.572214:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619648 00000100:00100000:1.0:1788752806.572232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788752806.572238:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619648:12345-0@lo:503: 00000100:00100000:1.0:1788752806.572718:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619648:12345-0@lo:503: Request processed in 478us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.572726:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788752806.572881:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619648:0@lo:503: 00000040:00080000:1.0:1788752806.573475:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788752806.573536:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619776:0@lo:502: 00000100:00100000:1.0:1788752806.573581:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752806.573673:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788752806.573707:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619776 00000100:00100000:2.0:1788752806.573712:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619776 00000100:00100000:2.0:1788752806.573777:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788752806.573785:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619776:12345-0@lo:502: 00000100:00100000:2.0:1788752806.573998:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619776:12345-0@lo:502: Request processed in 213us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752806.574006:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788752806.574112:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619776:0@lo:502: 00000040:00080000:3.0:1788752806.574612:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788752806.574677:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788752806.574713:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619904:0@lo:502: 00000100:00100000:3.0:1788752806.574755:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.574831:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.574867:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182619904 00000100:00100000:1.0:1788752806.574873:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182619904 00000100:00100000:1.0:1788752806.574948:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788752806.574957:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619904:12345-0@lo:502: 00000100:00100000:1.0:1788752806.575106:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182619904:12345-0@lo:502: Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.575113:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788752806.575224:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182619904:0@lo:502: 00000040:00080000:3.0:1788752806.575316:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788752806.575327:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788752806.575916:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788752806.575924:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752806.575926:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788752806.575932:0:6709:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bbd907800 00000020:00000080:0.0:1788752806.575935:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788752806.575952:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752806.575956:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752806.575957:0:6709:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788752806.575960:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788752806.576064:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788752806.576080:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788752806.576100:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.576111:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752806.576169:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788752806.576172:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c9bbd907800 10000000:01000000:3.0:1788752806.576174:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c9bbd907800 10000000:01000000:3.0:1788752806.576179:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788752806.576184:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9bbd907800 from 1 10000000:01000000:3.0:1788752806.576186:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788752806.576212:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.576220:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.576229:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752806.576244:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620032:0@lo:101: 00000100:00100000:3.0:1788752806.576443:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.576693:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752806.576752:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620032 00000100:00100000:2.0:1788752806.576758:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620032 00000100:00100000:2.0:1788752806.576785:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788752806.576792:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182620032:12345-0@lo:101: 00010000:00010000:2.0:1788752806.576803:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752806.576817:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fbec expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.576838:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fbec expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.576848:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fbec expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752806.576856:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928600, rc 0) 00000100:00100000:2.0:1788752806.576897:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620032:12345-0@lo:101: Request processed in 105us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752806.576903:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788752806.576994:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620032:0@lo:101: 00010000:00010000:3.0:1788752806.577007:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.577016:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752806.577086:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620160:0@lo:501: 00000100:00100000:3.0:1788752806.577179:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.577197:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752806.577284:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620160 00000100:00100000:2.0:1788752806.577296:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620160 00000100:00100000:2.0:1788752806.577324:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788752806.577330:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620160:12345-0@lo:501: 00000100:00100000:2.0:1788752806.577650:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620160:12345-0@lo:501: Request processed in 319us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752806.577666:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788752806.577728:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620160:0@lo:501: 00000100:00100000:3.0:1788752806.577751:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620288:0@lo:503: 00000100:00100000:3.0:1788752806.577781:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.577826:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752806.577870:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620288 00000100:00100000:0.0:1788752806.577874:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620288 00000100:00100000:1.0:1788752806.577959:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788752806.577966:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620288:12345-0@lo:503: 00000100:00100000:1.0:1788752806.578095:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620288:12345-0@lo:503: Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.578101:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788752806.578190:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620288:0@lo:503: 00000040:00080000:3.0:1788752806.578559:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788752806.578616:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620416:0@lo:502: 00000100:00100000:3.0:1788752806.578662:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.578883:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752806.578926:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620416 00000100:00100000:2.0:1788752806.578932:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620416 00000100:00100000:0.0:1788752806.578969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788752806.578978:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620416:12345-0@lo:502: 00000100:00100000:0.0:1788752806.579171:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620416:12345-0@lo:502: Request processed in 194us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752806.579178:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788752806.579266:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620416:0@lo:502: 00000040:00080000:3.0:1788752806.579648:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788752806.579715:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788752806.579753:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788752806.579803:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788752806.579864:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788752806.579910:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788752806.579947:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788752806.579980:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788752806.580023:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788752806.580060:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788752806.580111:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788752806.580199:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788752806.580235:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788752806.580266:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788752806.580522:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788752806.580563:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788752806.580599:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788752806.580646:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788752806.580692:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788752806.580727:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788752806.580773:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788752806.580808:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788752806.580842:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788752806.580889:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788752806.580925:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788752806.580959:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788752806.581033:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788752806.581071:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788752806.581114:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620544:0@lo:502: 00000100:00100000:3.0:1788752806.581244:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.581374:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752806.581498:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620544 00000100:00100000:1.0:1788752806.581506:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620544 00000100:00100000:1.0:1788752806.581551:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788752806.581559:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620544:12345-0@lo:502: 00000100:00100000:1.0:1788752806.581772:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620544:12345-0@lo:502: Request processed in 214us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752806.581780:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788752806.581860:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620544:0@lo:502: 00000040:00080000:3.0:1788752806.581929:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788752806.581939:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788752806.582690:0:6710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788752806.582716:0:6710:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c9a849eb380) 00000020:00000080:3.0:1788752806.582735:0:6710:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788752806.582808:0:6710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bbd907800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788752806.582814:0:6710:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9bbd907800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788752806.582816:0:6710:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bbd907800 3 00010000:00080000:3.0:1788752806.582848:0:6710:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9a849f1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.105@tcp at head 00010000:00010000:3.0:1788752806.586558:0:6710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788752806.586827:0:6710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788752806.586861:0:6710:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788752806.586873:0:6710:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x80c8383f4848fc01 00000100:00080000:3.0:1788752806.586882:0:6710:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788752806.586893:0:6710:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c9a849f1000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1788752806.586927:0:6710:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bbe550a80 x1875643182620672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788752806.586955:0:6710:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1788752806.587173:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1788752806.587428:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875643182620672:0@lo:38: 00000100:00100000:1.0:1788752806.587491:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788752806.587558:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788752806.587580:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788752806.587596:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.587606:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788752806.587663:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788752806.587665:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788752806.587667:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788752806.587668:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788752806.587669:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788752806.587670:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788752806.587671:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788752806.587673:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788752806.587674:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788752806.587676:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788752806.587677:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788752806.587681:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788752806.587683:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788752806.587684:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788752806.587685:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788752806.587686:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788752806.587687:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788752806.587688:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788752806.587694:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788752806.587695:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788752806.587696:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788752806.587697:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788752806.587697:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788752806.587713:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788752806.587725:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620800:0@lo:253: 00000100:00100000:1.0:1788752806.587758:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752806.587770:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f77f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752806.587885:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620672 00000100:00100000:3.0:1788752806.587893:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620672 00000100:00100000:3.0:1788752806.587929:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788752806.587936:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875643182620672:12345-0@lo:38: 00010000:00080000:3.0:1788752806.587957:0:5832:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:3.0:1788752806.587983:0:5832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x80c8383f4848fc08 00000004:00100000:3.0:1788752806.587994:0:5832:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788752806.588019:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9c9a849f7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752806.588069:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875643182620672:12345-0@lo:38: Request processed in 132us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752806.588076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788752806.588114:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c9bbe550a80 x1875643182620672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788752816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752806.588155:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788752806.588162:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788752806.588169:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788752806.588174:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788752806.588176:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9a849f1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788752806.588181:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875643182620672:0@lo:38: 00000100:00100000:3.0:1788752806.588362:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182620928:0@lo:400: 00000100:00100000:3.0:1788752806.588400:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.588430:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620928 00000100:00100000:3.0:1788752806.588434:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620928 00000100:00100000:3.0:1788752806.588460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788752806.588466:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182620928:12345-0@lo:400: 00000100:00100000:3.0:1788752806.588501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe550a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182620928:12345-0@lo:400: Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752806.588507:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788752806.588531:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c9b8733a300 x1875643182620928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752806.588541:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182620928:0@lo:400: 00000100:00100000:2.0:1788752806.588641:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182620800 00000100:00100000:2.0:1788752806.588646:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182620800 00000100:00100000:2.0:1788752806.588698:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788752806.588704:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6686:x1875643182620800:12345-0@lo:253: 20000000:01000000:2.0:1788752806.588724:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788752806.588734:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788752806.636457:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788752806.636506:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788752806.637230:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788752806.637235:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788752806.637372:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.637447:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b80030600/0x80c8383f4848fb6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.637458:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.637496:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b80030600/0x80c8383f4848fb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.637510:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b80030600/0x80c8383f4848fb6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 13 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752806.637525:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875643182621056:0@lo:104: 00000100:00100000:1.0:1788752806.637580:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752806.637634:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94c89780 going to sleep for 11 seconds 00000100:00100000:0.0:1788752806.637739:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621056 00000100:00100000:0.0:1788752806.637747:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621056 00000100:00100000:0.0:1788752806.637797:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788752806.637807:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5849:x1875643182621056:12345-0@lo:104: 00010000:00010000:0.0:1788752806.637820:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752806.637883:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788752806.637889:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5849:x1875643182621056:12345-0@lo:104: Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752806.637895:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788752806.637966:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875643182621056:0@lo:104: 00010000:00010000:2.0:1788752806.637985:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638119:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788752806.638137:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638146:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928800 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788752806.638158:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638166:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788752806.638173:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752806.638179:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788752806.638212:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638219:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788752806.638242:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638249:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b85928800/0x80c8383f4848fb67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb6e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638265:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752806.638267:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752806.638268:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752806.638276:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788752806.638296:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182621184:0@lo:103: 00000100:00100000:3.0:1788752806.638327:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752806.638353:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621184 00000100:00100000:3.0:1788752806.638358:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621184 00010000:00010000:3.0:1788752806.638374:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b80030600/0x80c8383f4848fb6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752806.638539:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788752806.638552:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b98cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3305:x1875643182621184:12345-0@lo:103: 00010000:00010000:3.0:1788752806.638563:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752806.638568:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b80030600/0x80c8383f4848fb6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638578:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b80030600/0x80c8383f4848fb6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638590:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b80030600/0x80c8383f4848fb6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fb67 expref: 14 pid: 5825 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638603:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638611:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788752806.638623:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001388793s 00010000:00010000:3.0:1788752806.638627:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638634:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638640:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638647:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638663:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173a00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788752806.638673:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638681:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638701:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752806.638711:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752806.638740:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b98cf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3305:x1875643182621184:12345-0@lo:103: Request processed in 189us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752806.638747:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788752806.638802:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182621184:0@lo:103: 00010000:00010000:1.0:1788752806.638855:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.638862:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752806.638879:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752806.646758:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:6686:x1875643182620800:12345-0@lo:253: Request processed in 58044us (58989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752806.646774:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788752806.646858:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:6686:1875643182620800:0@lo:253: 10000000:01000000:1.0:1788752806.646874:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788752806.646877:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788752806.646879:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788752806.646880:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788752806.646881:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788752806.646882:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788752806.646883:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788752806.646885:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788752806.646887:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788752806.646888:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788752806.646890:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788752806.646892:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788752806.646908:0:6686:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788752806.654108:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788752806.654345:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788752806.655092:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788752806.655555:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788752806.655753:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788752806.655985:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788752806.657239:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788752806.835471:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788752806.856523:0:6686:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788752806.856531:0:6686:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788752806.856567:0:6686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788752806.856621:0:6686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788752806.856635:0:6686:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788752806.856671:0:6686:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788752807.856838:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752808.874585:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788752809.708306:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788752809.708325:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9b90a5a800 from 21 10000000:01000000:1.0:1788752809.708330:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788752809.708369:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752809.708381:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752809.708392:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752809.708414:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621312:0@lo:101: 00000100:00100000:1.0:1788752809.708478:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752809.708528:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928efd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.712977:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621312 00000100:00100000:0.0:1788752809.712992:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621312 00000100:00100000:0.0:1788752809.713040:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788752809.713050:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182621312:12345-0@lo:101: 00010000:00010000:0.0:1788752809.713067:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752809.713097:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fc16 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.713143:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.713154:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.713175:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9400, rc 0) 00000100:00100000:0.0:1788752809.713256:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182621312:12345-0@lo:101: Request processed in 207us (4777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.713275:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788752809.713340:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621312:0@lo:101: 00010000:00010000:0.0:1788752809.713357:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.713366:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752809.713431:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621440:0@lo:501: 00000100:00100000:0.0:1788752809.713463:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.713506:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788752809.715294:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621440 00000100:00100000:3.0:1788752809.715308:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621440 00000100:00100000:3.0:1788752809.715365:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788752809.715384:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182621440:12345-0@lo:501: 00000100:00100000:3.0:1788752809.715815:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182621440:12345-0@lo:501: Request processed in 440us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752809.715824:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788752809.715983:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621440:0@lo:501: 00000100:00100000:0.0:1788752809.716030:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621568:0@lo:503: 00000100:00100000:0.0:1788752809.716077:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.716154:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788752809.716323:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621568 00000100:00100000:2.0:1788752809.716330:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621568 00000100:00100000:2.0:1788752809.716358:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788752809.716366:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182621568:12345-0@lo:503: 00000100:00100000:2.0:1788752809.716674:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182621568:12345-0@lo:503: Request processed in 308us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752809.716681:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788752809.716800:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621568:0@lo:503: 00000100:00100000:2.0:1788752809.717207:0:6879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6879:1875643182621696:0@lo:502: 00000100:00100000:2.0:1788752809.717245:0:6879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752809.717274:0:6879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b99485540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.717426:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621696 00000100:00100000:0.0:1788752809.717433:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621696 00000100:00100000:0.0:1788752809.717468:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788752809.717475:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6879:x1875643182621696:12345-0@lo:502: 00000100:00100000:0.0:1788752809.717709:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6879:x1875643182621696:12345-0@lo:502: Request processed in 233us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.717717:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788752809.717798:0:6879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6879:1875643182621696:0@lo:502: 00000100:00100000:3.0:1788752809.717841:0:6879:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6879:1875643182621824:0@lo:502: 00000100:00100000:3.0:1788752809.717885:0:6879:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752809.717908:0:6879:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9099b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.718153:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621824 00000100:00100000:0.0:1788752809.718167:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621824 00000100:00100000:0.0:1788752809.718204:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788752809.718210:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6879:x1875643182621824:12345-0@lo:502: 00000100:00100000:0.0:1788752809.718346:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:6879:x1875643182621824:12345-0@lo:502: Request processed in 135us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.718353:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788752809.718390:0:6879:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6879:1875643182621824:0@lo:502: 00000040:00080000:0.0:1788752809.718409:0:6879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788752809.718454:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788752809.718468:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788752809.718478:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.718488:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752809.718497:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788752809.718500:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9b90a5a800 from 4 10000000:01000000:0.0:1788752809.718502:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788752809.718526:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.718535:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.718544:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752809.718557:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621952:0@lo:101: 00000100:00100000:0.0:1788752809.718583:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.718603:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0486600 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.718615:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182621952 00000100:00100000:0.0:1788752809.718619:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182621952 00000100:00100000:0.0:1788752809.718647:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788752809.718653:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182621952:12345-0@lo:101: 00010000:00010000:0.0:1788752809.718660:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752809.718670:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fc24 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.718688:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.718698:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.718706:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8800, rc 0) 00000100:00100000:0.0:1788752809.718734:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182621952:12345-0@lo:101: Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.718740:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788752809.718770:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182621952:0@lo:101: 00010000:00010000:0.0:1788752809.718782:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.718789:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752809.718830:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622080:0@lo:256: 00000100:00100000:0.0:1788752809.718857:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.718882:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0486600 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.718899:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622080 00000100:00100000:0.0:1788752809.718902:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622080 00000100:00100000:0.0:1788752809.718917:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788752809.718922:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182622080:12345-0@lo:256: 20000000:01000000:0.0:1788752809.718933:0:5827:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788752809.718948:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788752809.718950:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788752809.719024:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182622080:12345-0@lo:256: Request processed in 100us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.719030:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788752809.719057:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622080:0@lo:256: 10000000:01000000:0.0:1788752809.719108:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788752809.719115:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.719143:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752809.719151:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788752809.719153:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788752809.719155:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788752809.719171:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.719178:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.719186:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752809.719210:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622208:0@lo:101: 00000100:00100000:0.0:1788752809.719234:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.719249:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.719261:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622208 00000100:00100000:0.0:1788752809.719265:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622208 00000100:00100000:0.0:1788752809.719285:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788752809.719290:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182622208:12345-0@lo:101: 00010000:00010000:0.0:1788752809.719297:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752809.719305:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fc32 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.719318:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.719326:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.719333:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752809.719362:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182622208:12345-0@lo:101: Request processed in 72us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.719368:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788752809.719404:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622208:0@lo:101: 00010000:00010000:0.0:1788752809.719418:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752809.719427:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752809.719478:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622336:0@lo:501: 00000100:00100000:0.0:1788752809.719502:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.719516:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.719531:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622336 00000100:00100000:0.0:1788752809.719534:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622336 00000100:00100000:0.0:1788752809.719553:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788752809.719559:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182622336:12345-0@lo:501: 00000100:00100000:0.0:1788752809.719779:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182622336:12345-0@lo:501: Request processed in 220us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.719786:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788752809.719815:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622336:0@lo:501: 00000100:00100000:0.0:1788752809.719839:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622464:0@lo:503: 00000100:00100000:0.0:1788752809.719872:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.719885:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb251e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.719896:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622464 00000100:00100000:0.0:1788752809.719899:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622464 00000100:00100000:0.0:1788752809.719915:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788752809.719920:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182622464:12345-0@lo:503: 00000100:00100000:0.0:1788752809.720205:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182622464:12345-0@lo:503: Request processed in 284us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.720212:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788752809.720246:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182622464:0@lo:503: 00000100:00100000:0.0:1788752809.720423:0:6880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6880:1875643182622592:0@lo:502: 00000100:00100000:0.0:1788752809.720453:0:6880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.720476:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622592 00000100:00100000:0.0:1788752809.720480:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622592 00000100:00100000:0.0:1788752809.720495:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788752809.720500:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:6880:x1875643182622592:12345-0@lo:502: 00000100:00100000:0.0:1788752809.720682:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:6880:x1875643182622592:12345-0@lo:502: Request processed in 181us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.720688:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788752809.720714:0:6880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb251e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.720727:0:6880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6880:1875643182622592:0@lo:502: 00000020:01000000:0.0:1788752809.720747:0:6880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788752809.720753:0:6880:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788752809.720759:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752809.720761:0:6880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788752809.720769:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788752809.720772:0:6880:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000020:01000000:0.0:1788752809.720791:0:6880:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788752809.720794:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788752809.720808:0:6880:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c9b873199c0) 00000020:00000080:0.0:1788752809.720827:0:6880:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788752809.720832:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788752809.720911:0:6880:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788752809.720916:0:6880:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788752809.720924:0:6880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f4848fc47 00010000:00080000:0.0:1788752809.720950:0:6880:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9ba0106000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1788752809.721986:0:6880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788752809.772613:0:6880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788752809.772646:0:6880:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788752809.773444:0:6880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788752809.773641:0:6880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788752809.773694:0:6880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788752809.773753:0:6880:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788752809.777897:0:6881:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788752809.777917:0:6881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788752809.779371:0:6880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788752809.779384:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788752809.779420:0:6880:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788752809.779440:0:6880:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f4848fc4e 00000100:00080000:2.0:1788752809.779449:0:6880:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788752809.779459:0:6880:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c9ba0106000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1788752809.779495:0:6880:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9b8733aa00 x1875643182622720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788752809.779522:0:6880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788752809.779610:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182622720:0@lo:8: 00000100:00100000:1.0:1788752809.779622:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182622848:0@lo:400: 00000100:00100000:3.0:1788752809.779688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752809.779764:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622720 00000100:00100000:3.0:1788752809.779771:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622720 00000100:00100000:1.0:1788752809.779773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752809.779796:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752809.779803:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182622976:0@lo:400: 00000100:00100000:3.0:1788752809.779819:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788752809.779822:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752809.779825:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3302:x1875643182622720:12345-0@lo:8: 00010000:00080000:3.0:1788752809.779850:0:6688:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000100:00100000:1.0:1788752809.779851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622848 00000100:00100000:1.0:1788752809.779854:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622848 00000020:00000080:3.0:1788752809.779873:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f4848fc55 00002000:00100000:3.0:1788752809.779911:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c9a849f2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788752809.779916:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788752809.779919:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788752809.779962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182622976 00000100:00100000:1.0:1788752809.779966:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182622976 00000100:00100000:1.0:1788752809.779992:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788752809.779998:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182622848:12345-0@lo:400: 00002000:00100000:3.0:1788752809.780026:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788752809.780043:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182622848:12345-0@lo:400: Request processed in 44us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752809.780049:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788752809.780063:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788752809.780075:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182622976:12345-0@lo:400: 00000100:00100000:1.0:1788752809.780104:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182622976:12345-0@lo:400: Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752809.780109:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788752809.780167:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe07ea00 x1875643182622976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752809.780180:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182622976:0@lo:400: 00010000:00080000:1.0:1788752809.780191:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe07ce00 x1875643182622848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1788752809.780193:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788752809.780199:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182622848:0@lo:400: 00000100:00080000:3.0:1788752809.780228:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9c9a849f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752809.780272:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875643182622720:12345-0@lo:8: Request processed in 445us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752809.780278:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788752809.780697:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9b8733aa00 x1875643182622720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788752819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752809.780706:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788752809.780710:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788752809.780713:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788752809.780720:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788752809.780724:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788752809.780727:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9ba0106000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788752809.780745:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788752809.780749:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182622720:0@lo:8: 00000004:00080000:3.0:1788752809.780854:0:6881:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788752809.780969:0:6881:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 209514845414ns, next at 0ns, rc = 0 00000020:01000000:2.0:1788752809.782016:0:6880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788752809.782024:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752809.782026:0:6880:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788752809.782030:0:6880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788752809.782034:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752809.782035:0:6880:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788752809.782038:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788752809.782040:0:6880:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788752809.782078:0:6880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6880:1875643182623104:0@lo:502: 00000100:00100000:2.0:1788752809.782168:0:6880:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752809.783974:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182623104 00000100:00100000:2.0:1788752809.783986:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182623104 00000100:00100000:2.0:1788752809.784027:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788752809.784036:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:6880:x1875643182623104:12345-0@lo:502: 00000100:00100000:2.0:1788752809.785514:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:6880:x1875643182623104:12345-0@lo:502: Request processed in 1472us (3340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752809.785526:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788752809.785595:0:6880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b99485180 going to sleep for 11 seconds 00000100:00100000:2.0:1788752809.785620:0:6880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:6880:1875643182623104:0@lo:502: 00000020:01000000:2.0:1788752809.785675:0:6880:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788752809.785682:0:6880:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752809.785684:0:6880:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788752809.785688:0:6880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788752809.786310:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788752809.786329:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788752809.786341:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752809.786353:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752809.786363:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788752809.786367:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c9b8731b380 from 1 10000000:01000000:3.0:1788752809.786369:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788752809.786412:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752809.786420:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752809.786429:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752809.786447:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182623232:0@lo:101: 00000100:00100000:3.0:1788752809.786494:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752809.786522:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9099b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752809.786998:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182623232 00000100:00100000:2.0:1788752809.787006:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182623232 00000100:00100000:2.0:1788752809.787050:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788752809.787059:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182623232:12345-0@lo:101: 00010000:00010000:2.0:1788752809.787072:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752809.787086:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fc5c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752809.787110:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752809.787148:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752809.787157:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928e00, rc 0) 00000100:00100000:2.0:1788752809.787209:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182623232:12345-0@lo:101: Request processed in 150us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752809.787223:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788752809.787240:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182623232:0@lo:101: 00010000:00010000:3.0:1788752809.787254:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752809.787263:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752809.787315:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182623360:0@lo:501: 00000100:00100000:3.0:1788752809.787342:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752809.787367:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9099b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752809.788004:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182623360 00000100:00100000:2.0:1788752809.788012:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182623360 00000100:00100000:2.0:1788752809.788048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788752809.788056:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182623360:12345-0@lo:501: 00000100:00100000:2.0:1788752809.788305:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182623360:12345-0@lo:501: Request processed in 249us (961us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788752809.788312:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788752809.788363:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182623360:0@lo:501: 10000000:01000000:2.0:1788752809.788413:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788752809.788421:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752809.788429:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788752809.847956:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788752809.878509:0:6882:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788752809.878547:0:6882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182623616:0@lo:7: 00000100:00100000:0.0:1788752809.878724:0:6882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.878808:0:6882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8fa6b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752809.878969:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182623616 00000100:00100000:3.0:1788752809.878979:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182623616 00000100:00100000:3.0:1788752809.879065:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788752809.879076:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6882:x1875643182623616:12345-0@lo:7: 00000100:00080000:0.0:1788752809.879303:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788752809.880737:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182623488:0@lo:13: 00000100:00100000:1.0:1788752809.880823:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752809.881260:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182623488 00000100:00100000:0.0:1788752809.881272:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182623488 00000100:00100000:0.0:1788752809.881332:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788752809.881628:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875643182623488:12345-0@lo:13: 00002000:00000024:0.0:1788752809.881680:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788752809.881765:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875643182623488:12345-0@lo:13: Request processed in 422us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.881773:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788752809.881816:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bae9d3800 x1875643182623488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752809.881840:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182623488:0@lo:13: 00002000:00080000:0.0:1788752809.888302:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788752809.888313:0:6691:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788752809.888698:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6882:x1875643182623616:12345-0@lo:7: Request processed in 9614us (9965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752809.888717:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788752809.888758:0:6882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bae9d3b80 x1875643182623616/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788752825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752809.888778:0:6882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182623616:0@lo:7: 00000004:00080000:2.0:1788752809.888798:0:6882:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788752809.888855:0:6882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182623744:0@lo:5: 00000100:00100000:2.0:1788752809.888901:0:6882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752809.888967:0:6882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752809.889030:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182623744 00000100:00100000:0.0:1788752809.889038:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182623744 00000100:00100000:0.0:1788752809.889088:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788752809.889098:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6882:x1875643182623744:12345-0@lo:5: 00002000:00080000:0.0:1788752809.889228:0:6690:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788752809.889234:0:6690:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788752809.889588:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6882:x1875643182623744:12345-0@lo:5: Request processed in 489us (685us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788752809.889596:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788752809.891545:0:6882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9b87338380 x1875643182623744/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788752825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752809.891790:0:6882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182623744:0@lo:5: 00000004:00080000:2.0:1788752809.891811:0:6882:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788752809.891867:0:6882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182623872:0@lo:700: 00000100:00100000:2.0:1788752809.891933:0:6882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752809.892008:0:6882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752809.892050:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182623872 00000100:00100000:3.0:1788752809.892061:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182623872 00000100:00100000:3.0:1788752809.892112:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788752809.892154:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6882:x1875643182623872:12345-0@lo:700: 00000100:00100000:3.0:1788752809.892207:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1875643182624000:0@lo:700: 00000100:00100000:2.0:1788752809.892230:0:6698:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:2.0:1788752809.892240:0:6698:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:3.0:1788752809.892248:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752809.892286:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9099b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788752809.892449:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624000 00000100:00100000:1.0:1788752809.892454:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624000 00000100:00100000:1.0:1788752809.892492:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788752809.892500:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1875643182624000:12345-0@lo:700: 00010000:00010000:2.0:1788752809.900110:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1788752809.941649:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788752809.955363:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe550000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1875643182624000:12345-0@lo:700: Request processed in 62859us (63110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752809.955387:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788752809.955503:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe551c00 x1875643182624000/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788752825 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752809.955521:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1875643182624000:0@lo:700: 40000000:02000000:0.0:1788752809.955534:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788752810.017743:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788752810.017770:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788752810.017911:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6882:x1875643182623872:12345-0@lo:700: Request processed in 125758us (125974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752810.017923:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788752810.018019:0:6882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9b87339880 x1875643182623872/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788752825 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752810.018032:0:6882:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788752810.018049:0:6882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182623872:0@lo:700: 00000004:02000040:1.0:1788752810.069472:0:6882:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788752810.079356:0:6882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182624128:0@lo:5: 00000100:00100000:1.0:1788752810.079419:0:6882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752810.079467:0:6882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef300 going to sleep for 11 seconds 00000100:00100000:0.0:1788752810.079512:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624128 00000100:00100000:0.0:1788752810.079521:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624128 00000100:00100000:0.0:1788752810.079570:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788752810.079579:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6882:x1875643182624128:12345-0@lo:5: 00002000:00080000:2.0:1788752810.094570:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788752810.094588:0:6691:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788752810.099448:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6882:x1875643182624128:12345-0@lo:5: Request processed in 19864us (20022us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788752810.099462:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788752810.101650:0:6882:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe07ea00 x1875643182624128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788752826 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752810.101670:0:6882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6882:1875643182624128:0@lo:5: 00000004:00080000:3.0:1788752810.101686:0:6882:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788752810.925016:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752811.946348:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788752812.517925:0:7058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788752812.970455:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752813.994307:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752815.018384:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752815.274678:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182624256:0@lo:13: 00000100:00100000:0.0:1788752815.274748:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752815.275271:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182624384:0@lo:400: 00000100:00100000:1.0:1788752815.275328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752815.275401:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752815.275408:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182624512:0@lo:400: 00000100:00100000:1.0:1788752815.275432:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752815.275464:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624512 00000100:00100000:1.0:1788752815.275471:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624512 00000100:00100000:1.0:1788752815.275513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788752815.275521:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182624512:12345-0@lo:400: 00000100:00100000:1.0:1788752815.275570:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182624512:12345-0@lo:400: Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752815.275576:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788752815.275633:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe07d500 x1875643182624512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752815.275647:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182624512:0@lo:400: 00000100:00100000:0.0:1788752815.276023:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182624768:0@lo:400: 00000100:00100000:0.0:1788752815.276054:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752815.276071:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788752815.276077:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182624640:0@lo:400: 00000100:00100000:0.0:1788752815.276098:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752815.279494:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624768 00000100:00100000:1.0:1788752815.279512:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624768 00000100:00100000:1.0:1788752815.279577:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788752815.279588:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182624768:12345-0@lo:400: 00000100:00100000:1.0:1788752815.279688:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182624768:12345-0@lo:400: Request processed in 102us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752815.279695:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788752815.279720:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624640 00000100:00100000:1.0:1788752815.279724:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624640 00000100:00100000:1.0:1788752815.279749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788752815.279755:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182624640:12345-0@lo:400: 00000100:00100000:1.0:1788752815.279788:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182624640:12345-0@lo:400: Request processed in 33us (3689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752815.279795:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788752815.280155:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788752815.280161:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788752815.280207:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe07ed80 x1875643182624640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752815.280222:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182624640:0@lo:400: 00010000:00080000:0.0:1788752815.280236:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe07ca80 x1875643182624768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752815.280245:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182624768:0@lo:400: 00000100:00100000:3.0:1788752815.284506:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624256 00000100:00100000:3.0:1788752815.284522:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624256 00000100:00100000:2.0:1788752815.287244:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624384 00000100:00100000:2.0:1788752815.287260:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624384 00000100:00100000:2.0:1788752815.287331:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788752815.287342:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3303:x1875643182624384:12345-0@lo:400: 00000100:00100000:2.0:1788752815.287433:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3303:x1875643182624384:12345-0@lo:400: Request processed in 93us (12111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752815.287440:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788752815.288849:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752815.288859:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182624256:12345-0@lo:13: 00002000:00000024:2.0:1788752815.288890:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752815.289407:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182624384:0@lo:400: 00010000:00080000:1.0:1788752815.289829:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe551f80 x1875643182624256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752815.289878:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182624256:0@lo:13: 00000100:00100000:2.0:1788752815.290073:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182624256:12345-0@lo:13: Request processed in 1214us (15323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752815.290082:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1788752815.356529:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788752816.047854:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752817.066356:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752818.091309:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752819.116110:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752820.138653:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752820.396439:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182625024:0@lo:400: 00000100:00100000:1.0:1788752820.396540:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752820.396630:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788752820.396637:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182624896:0@lo:13: 00000100:00100000:1.0:1788752820.396668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752820.396687:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182625408:0@lo:400: 00000100:00100000:1.0:1788752820.396726:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752820.396757:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182625280:0@lo:400: 00000100:00100000:1.0:1788752820.396785:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752820.396804:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788752820.396810:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182625152:0@lo:400: 00000100:00100000:1.0:1788752820.396829:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752820.396860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625024 00000100:00100000:1.0:1788752820.396870:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625024 00000100:00100000:1.0:1788752820.396915:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788752820.396925:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3304:x1875643182625024:12345-0@lo:400: 00000100:00100000:2.0:1788752820.397361:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625408 00000100:00100000:2.0:1788752820.397367:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625408 00000100:00100000:2.0:1788752820.397414:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752820.397422:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182625408:12345-0@lo:400: 00000100:00100000:2.0:1788752820.397487:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182625408:12345-0@lo:400: Request processed in 66us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752820.397494:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788752820.397538:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752820.399266:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625280 00000100:00100000:2.0:1788752820.399282:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625280 00000100:00100000:2.0:1788752820.399354:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625152 00000100:00100000:2.0:1788752820.399358:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625152 00000100:00100000:2.0:1788752820.399378:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788752820.399388:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182625280:12345-0@lo:400: 00000100:00100000:2.0:1788752820.399492:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182625280:12345-0@lo:400: Request processed in 105us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752820.399500:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788752820.399521:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788752820.399528:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182625152:12345-0@lo:400: 00000100:00100000:2.0:1788752820.399569:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182625152:12345-0@lo:400: Request processed in 32us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752820.399576:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788752820.399606:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182624896 00000100:00100000:2.0:1788752820.399610:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182624896 00000100:00100000:2.0:1788752820.399634:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788752820.399641:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182624896:12345-0@lo:13: 00000100:00100000:1.0:1788752820.401530:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3304:x1875643182625024:12345-0@lo:400: Request processed in 4595us (4980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752820.401545:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788752820.401702:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe551c00 x1875643182625408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752820.401715:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788752820.401738:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182625408:0@lo:400: 00000100:00100000:1.0:1788752820.401750:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182625024:0@lo:400: 00010000:00080000:1.0:1788752820.401791:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe553800 x1875643182625152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752820.401802:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182625152:0@lo:400: 00010000:00080000:1.0:1788752820.401815:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe551f80 x1875643182625280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752820.401823:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182625280:0@lo:400: 00002000:00000024:2.0:1788752820.402255:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752820.402320:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182624896:12345-0@lo:13: Request processed in 2678us (5649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752820.402328:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788752820.402373:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788752820.402533:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe553480 x1875643182624896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752820.402554:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182624896:0@lo:13: 00010000:00010000:3.0:1788752821.162576:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752822.186806:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788752822.470695:0:7609:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788752822.470699:0:7609:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788752822.470857:0:7609:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c9bafe44000 00000020:01000004:1.0:1788752822.470872:0:7609:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788752822.470885:0:7609:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788752822.470899:0:7609:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c9b88b43380) 00000020:00000080:1.0:1788752822.470915:0:7609:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788752822.494404:0:7609:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788752822.494657:0:7609:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788752822.515586:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788752822.526381:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788752822.526421:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788752822.526479:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788752822.526504:0:7609:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788752822.526834:0:7609:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788752822.526845:0:7609:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788752822.526856:0:7609:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x80c8383f4848fc71 00000020:01000004:3.0:1788752822.526864:0:7609:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788752822.526884:0:7609:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788752822.526888:0:7609:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788752822.526894:0:7609:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788752822.526929:0:7609:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788752822.526933:0:7609:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788752822.554593:0:7609:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788752822.554630:0:7609:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.105@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788752822.554634:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788752822.554636:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788752822.554638:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788752822.554639:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788752822.554640:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788752822.554641:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788752822.554642:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788752822.554644:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788752822.554645:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788752822.554647:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788752822.554648:0:7609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788752822.554651:0:7609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788752822.554654:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788752822.554656:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788752822.554657:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788752822.554658:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788752822.554659:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788752822.554660:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788752822.554661:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788752822.554662:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788752822.554663:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788752822.554664:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788752822.554665:0:7609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788752822.554691:0:7609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788752822.554708:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182625536:0@lo:253: 00000100:00100000:2.0:1788752822.554776:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752822.554885:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b875d3240 going to sleep for 11 seconds 00000100:00100000:0.0:1788752822.555027:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625536 00000100:00100000:0.0:1788752822.555035:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625536 00000100:00100000:0.0:1788752822.555145:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788752822.555156:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:7609:x1875643182625536:12345-0@lo:253: 20000000:01000000:0.0:1788752822.555260:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788752822.555264:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788752822.555268:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788752822.555270:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788752822.556570:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788752822.557353:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788752822.557371:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788752822.557417:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788752822.557425:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788752822.557475:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788752822.557604:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788752822.558367:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788752822.558389:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:0.0:1788752822.558391:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:0.0:1788752822.558431:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788752822.558438:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788752822.558486:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788752822.558574:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:0.0:1788752822.558612:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788752822.558621:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788752822.558650:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788752822.558715:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788752822.559725:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788752822.559748:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.105@tcp 20000000:01000000:0.0:1788752822.559756:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.105@tcp (null) (null) (null) 00000040:00080000:0.0:1788752822.559792:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788752822.559799:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788752822.559826:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788752822.559832:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.105@tcp (null) (null) 00000040:00080000:0.0:1788752822.559860:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788752822.559869:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788752822.559940:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788752822.560064:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788752822.560082:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788752822.560084:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788752822.560088:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788752822.560101:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788752822.560104:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788752822.560325:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788752822.560328:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788752822.560909:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788752822.561049:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788752822.561108:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788752822.564322:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788752822.564456:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788752822.564615:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788752822.564631:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788752822.564634:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788752822.565099:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788752822.565586:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788752822.565633:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788752822.565712:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788752822.565726:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788752822.565728:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788752822.566605:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1788752822.566663:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1788752822.566718:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788752822.567082:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788752822.567343:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788752822.567386:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788752822.567400:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788752822.567402:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788752822.568322:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788752822.568402:0:7614:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788752822.568436:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788752822.568787:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788752822.568830:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788752822.568886:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788752822.568904:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1788752822.568906:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1788752822.568915:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788752822.568944:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569033:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569042:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fbec expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569049:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569057:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569064:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569072:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569110:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569324:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 16 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.569340:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182625664:0@lo:104: 00000100:00100000:1.0:1788752822.569404:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752822.569574:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569593:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 16 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.569602:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182625792:0@lo:104: 00010000:00010000:1.0:1788752822.569630:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569639:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 16 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.569647:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182625920:0@lo:104: 00010000:00010000:1.0:1788752822.569669:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fbec expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569676:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fbec expref: 16 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.569683:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182626048:0@lo:104: 00010000:00010000:1.0:1788752822.569703:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.569711:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 16 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.569718:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182626176:0@lo:104: 00000100:00100000:1.0:1788752822.569734:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093900 going to sleep for 11 seconds 00000100:00100000:0.0:1788752822.569791:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788752822.569810:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.569870:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.569925:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752822.569944:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625664 00000100:00100000:2.0:1788752822.569951:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625664 00000100:00100000:2.0:1788752822.569995:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625792 00000100:00100000:2.0:1788752822.570004:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625792 00000100:00100000:2.0:1788752822.570019:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182625920 00000100:00100000:2.0:1788752822.570021:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182625920 00000100:00100000:2.0:1788752822.570034:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788752822.570043:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba013c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+5:5827:x1875643182625664:12345-0@lo:104: 00010000:00010000:2.0:1788752822.570055:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570151:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788752822.570158:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba013c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+5:5827:x1875643182625664:12345-0@lo:104: Request processed in 117us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.570165:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788752822.570331:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182625664:0@lo:104: 00000100:00100000:2.0:1788752822.570405:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788752822.570412:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:5827:x1875643182625792:12345-0@lo:104: 00010000:00010000:2.0:1788752822.570421:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570467:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788752822.570472:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:5827:x1875643182625792:12345-0@lo:104: Request processed in 61us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.570479:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788752822.570493:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788752822.570612:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182625792:0@lo:104: 00000100:00100000:2.0:1788752822.570646:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5827:x1875643182625920:12345-0@lo:104: 00010000:00010000:2.0:1788752822.570654:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570697:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788752822.570702:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5827:x1875643182625920:12345-0@lo:104: Request processed in 204us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.570713:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788752822.570732:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788752822.570737:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570745:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2c400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788752822.570749:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570757:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788752822.570764:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752822.570770:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788752822.570799:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570806:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788752822.570823:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570830:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c400/0x80c8383f4848fc5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc63 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570843:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788752822.570846:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570862:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8c00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788752822.570865:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570872:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788752822.570878:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752822.570883:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788752822.570896:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570902:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788752822.570916:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570923:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fc32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc39 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570932:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788752822.570935:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.570941:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788752822.570944:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.571040:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752822.571055:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182626304:0@lo:103: 00000100:00100000:1.0:1788752822.571087:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.571139:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788752822.571147:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182626432:0@lo:103: 00000100:00100000:1.0:1788752822.571169:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.571209:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626304 00000100:00100000:1.0:1788752822.571214:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626304 00010000:00010000:1.0:1788752822.571249:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 17 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.571270:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626432 00000100:00100000:1.0:1788752822.571273:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626432 00010000:00010000:1.0:1788752822.571284:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 18 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.571294:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788752822.571300:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3304:x1875643182626304:12345-0@lo:103: 00010000:00010000:1.0:1788752822.571310:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752822.571315:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 18 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.571324:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 18 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.571337:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928e00/0x80c8383f4848fc63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fc5c expref: 18 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.571369:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752822.571398:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:3304:x1875643182626304:12345-0@lo:103: Request processed in 98us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.571405:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788752822.571417:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788752822.571423:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3306:x1875643182626432:12345-0@lo:103: 00010000:00010000:1.0:1788752822.571430:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752822.571434:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 16 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.571443:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 16 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.571452:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fc39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fc32 expref: 16 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.571461:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752822.571485:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:3306:x1875643182626432:12345-0@lo:103: Request processed in 63us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.571627:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788752822.571664:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182626432:0@lo:103: 00000100:00100000:1.0:1788752822.571688:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182626304:0@lo:103: 00000100:00100000:1.0:1788752822.571706:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182625920:0@lo:104: 00010000:00010000:2.0:1788752822.571768:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788752822.571775:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752822.571781:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788752822.571797:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.571803:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788752822.571818:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.571825:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173200/0x80c8383f4848fc16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc1d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.571835:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752822.571837:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752822.571839:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752822.571853:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788752822.571862:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182626560:0@lo:103: 00000100:00100000:2.0:1788752822.571888:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788752822.571974:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752822.572054:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626560 00000100:00100000:1.0:1788752822.572058:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626560 00010000:00010000:1.0:1788752822.572072:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 15 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.572105:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788752822.572111:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:3305:x1875643182626560:12345-0@lo:103: 00010000:00010000:1.0:1788752822.572119:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752822.572149:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 15 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.572158:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 15 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.572169:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc9400/0x80c8383f4848fc1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fc16 expref: 15 pid: 5826 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.572262:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752822.572290:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3305:x1875643182626560:12345-0@lo:103: Request processed in 179us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.572296:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788752822.572351:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182626560:0@lo:103: 00000100:00100000:0.0:1788752822.572446:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752822.572559:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626048 00000100:00100000:2.0:1788752822.572563:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626048 00000100:00100000:2.0:1788752822.572580:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626176 00000100:00100000:2.0:1788752822.572582:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626176 00000100:00100000:2.0:1788752822.572591:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788752822.572602:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:5827:x1875643182626048:12345-0@lo:104: 00010000:00010000:2.0:1788752822.572611:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.572705:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182626048:0@lo:104: 00010000:00010000:2.0:1788752822.572731:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788752822.572736:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:5827:x1875643182626048:12345-0@lo:104: Request processed in 135us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.572742:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788752822.572758:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788752822.572764:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5827:x1875643182626176:12345-0@lo:104: 00010000:00010000:2.0:1788752822.572771:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.572838:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5827:1875643182626176:0@lo:104: 00010000:00010000:1.0:1788752822.572864:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.572894:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788752822.572902:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788752822.573440:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788752822.573447:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.573455:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2c000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788752822.573458:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.573466:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788752822.573472:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752822.573478:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788752822.573647:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788752822.573654:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5827:x1875643182626176:12345-0@lo:104: Request processed in 890us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.573662:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788752822.573707:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788752822.573712:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.573728:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85929a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788752822.573731:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.573737:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788752822.573743:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752822.573748:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788752822.573780:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.573786:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788752822.573861:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182626688:0@lo:103: 00000100:00100000:0.0:1788752822.573900:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752822.573988:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626688 00000100:00100000:2.0:1788752822.573994:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626688 00010000:00010000:2.0:1788752822.574012:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 14 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752822.574041:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788752822.574048:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3303:x1875643182626688:12345-0@lo:103: 00010000:00010000:2.0:1788752822.574057:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752822.574061:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 14 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.574079:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 14 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.574092:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fbc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fbc2 expref: 14 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.574105:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752822.574159:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3303:x1875643182626688:12345-0@lo:103: Request processed in 112us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.574165:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788752822.574263:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182626688:0@lo:103: 00010000:00010000:1.0:1788752822.574445:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.574455:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788752822.574832:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.574849:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788752822.574860:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182626816:0@lo:103: 00000100:00100000:0.0:1788752822.574892:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752822.574921:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c000/0x80c8383f4848fbec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbf3 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.574938:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752822.574941:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752822.574944:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752822.575033:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626816 00000100:00100000:2.0:1788752822.575040:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626816 00010000:00010000:2.0:1788752822.575060:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fbec expref: 13 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752822.575090:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788752822.575097:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3303:x1875643182626816:12345-0@lo:103: 00010000:00010000:2.0:1788752822.575105:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752822.575109:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fbec expref: 13 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575118:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fbec expref: 13 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575174:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fbf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fbec expref: 13 pid: 5825 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575198:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575230:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575245:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575252:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575258:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575264:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575269:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788752822.575273:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575280:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575298:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.575309:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752822.575352:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:3303:x1875643182626816:12345-0@lo:103: Request processed in 255us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.575359:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788752822.575513:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182626816:0@lo:103: 00010000:00010000:0.0:1788752822.575540:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.575558:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.575565:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173400/0x80c8383f4848fc78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788752822.575580:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1788752822.578360:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.578380:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b85929a00/0x80c8383f4848fbc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbc9 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.578420:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752822.578423:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752822.578425:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752822.639299:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+11:7609:x1875643182625536:12345-0@lo:253: Request processed in 84136us (84513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752822.639314:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788752822.639438:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182625536:0@lo:253: 10000000:01000000:0.0:1788752822.639453:0:7609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788752822.639456:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788752822.639457:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788752822.639459:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788752822.639460:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788752822.639461:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788752822.639463:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788752822.639464:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788752822.639465:0:7609:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788752822.639467:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788752822.639469:0:7609:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788752822.639489:0:7609:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c9bafe44000 from lustre-OST0001 10000000:01000000:0.0:1788752822.639515:0:7609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788752822.639518:0:7609:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788752822.639525:0:7609:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c9b8731b380 local copy 10000000:01000000:0.0:1788752822.639529:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788752822.639571:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.639582:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.639609:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.639627:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182626944:0@lo:101: 00000100:00100000:0.0:1788752822.639661:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.639752:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.639845:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182626944 00000100:00100000:1.0:1788752822.639852:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182626944 00000100:00100000:1.0:1788752822.639924:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788752822.639998:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+11:7609:x1875643182626944:12345-0@lo:101: 00010000:00010000:1.0:1788752822.640010:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752822.640024:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fc7f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.640046:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fc7f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.640056:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc7f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.640065:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173a00, rc 0) 00000100:00100000:1.0:1788752822.640101:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182626944:12345-0@lo:101: Request processed in 169us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.640108:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788752822.640285:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182626944:0@lo:101: 00010000:00010000:0.0:1788752822.640298:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.640307:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.640420:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627072:0@lo:501: 00000100:00100000:0.0:1788752822.640447:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.640538:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788752822.640623:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627072 00000100:00100000:2.0:1788752822.640634:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627072 00000100:00100000:2.0:1788752822.640656:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788752822.640662:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627072:12345-0@lo:501: 00000100:00100000:2.0:1788752822.640876:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627072:12345-0@lo:501: Request processed in 213us (426us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788752822.640883:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788752822.641029:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627072:0@lo:501: 10000000:01000000:0.0:1788752822.641043:0:7609:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788752822.641070:0:7609:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788752822.641075:0:7609:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.641084:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.641091:0:7609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.641139:0:7609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788752822.641159:0:7609:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c9bafe44000 10000000:01000000:0.0:1788752822.641164:0:7609:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788752822.641169:0:7609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788752822.641172:0:7609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788752822.641239:0:7609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788752822.641243:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788752822.641264:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.641273:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.641282:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.641295:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627200:0@lo:101: 00000100:00100000:0.0:1788752822.641323:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.641337:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d480 going to sleep for 11 seconds 00010000:00010000:2.0:1788752822.641394:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788752822.641400:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641407:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788752822.641411:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641420:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788752822.641438:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752822.641445:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788752822.641462:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641468:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788752822.641495:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641503:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8e00/0x80c8383f4848fc7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x80c8383f4848fc86 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641526:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752822.641527:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752822.641529:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752822.641539:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627200 00000100:00100000:2.0:1788752822.641553:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627200 00000100:00100000:2.0:1788752822.641575:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788752822.641580:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627200:12345-0@lo:101: 00010000:00010000:2.0:1788752822.641589:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752822.641599:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fc8d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641615:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641624:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.641631:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928600, rc 0) 00000100:00100000:2.0:1788752822.641659:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182627200:12345-0@lo:101: Request processed in 78us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.641664:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788752822.641906:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182627328:0@lo:103: 00000100:00100000:0.0:1788752822.642000:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.642058:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627200:0@lo:101: 00010000:00010000:0.0:1788752822.642070:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.642079:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.642255:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627456:0@lo:501: 00000100:00100000:0.0:1788752822.642281:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.642292:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788752822.642379:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627328 00000100:00100000:2.0:1788752822.642385:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627328 00000100:00100000:2.0:1788752822.642418:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752822.642424:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3305:x1875643182627328:12345-0@lo:103: 00010000:00010000:2.0:1788752822.642434:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752822.642446:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173a00/0x80c8383f4848fc86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fc7f expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.642462:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752822.642495:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:3305:x1875643182627328:12345-0@lo:103: Request processed in 70us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.642501:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752822.642530:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182627328:0@lo:103: 00000100:00100000:2.0:1788752822.642556:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627456 00000100:00100000:2.0:1788752822.642559:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627456 00000100:00100000:2.0:1788752822.642574:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788752822.642579:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627456:12345-0@lo:501: 00000100:00100000:2.0:1788752822.642775:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627456:12345-0@lo:501: Request processed in 195us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752822.642782:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788752822.643015:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627456:0@lo:501: 00000100:00100000:0.0:1788752822.643046:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627584:0@lo:503: 00000100:00100000:0.0:1788752822.643084:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.643111:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788752822.643272:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627584 00000100:00100000:3.0:1788752822.643277:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627584 00000100:00100000:3.0:1788752822.643317:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788752822.643324:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627584:12345-0@lo:503: 00000100:00100000:3.0:1788752822.643472:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627584:12345-0@lo:503: Request processed in 148us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752822.643479:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788752822.643575:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627584:0@lo:503: 00000040:00080000:0.0:1788752822.643832:0:7609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788752822.643891:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627712:0@lo:502: 00000100:00100000:0.0:1788752822.643924:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.644141:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.644278:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627712 00000100:00100000:1.0:1788752822.644283:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627712 00000100:00100000:1.0:1788752822.644305:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788752822.644311:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627712:12345-0@lo:502: 00000100:00100000:1.0:1788752822.644473:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627712:12345-0@lo:502: Request processed in 161us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.644481:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788752822.644576:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627712:0@lo:502: 00000040:00080000:0.0:1788752822.644820:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788752822.644867:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788752822.644899:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788752822.644956:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788752822.644993:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788752822.645027:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788752822.645054:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627840:0@lo:502: 00000100:00100000:0.0:1788752822.645093:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.645143:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.645300:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627840 00000100:00100000:1.0:1788752822.645305:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627840 00000100:00100000:1.0:1788752822.645326:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788752822.645333:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627840:12345-0@lo:502: 00000100:00100000:1.0:1788752822.645458:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627840:12345-0@lo:502: Request processed in 124us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.645465:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788752822.645541:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627840:0@lo:502: 00000040:00080000:0.0:1788752822.645634:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788752822.645648:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788752822.646204:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788752822.646212:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788752822.646218:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752822.646221:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788752822.646225:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788752822.646246:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c9a841619c0) 00000020:00000080:0.0:1788752822.646270:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788752822.646277:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788752822.646347:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bafe44000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788752822.646354:0:7616:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788752822.646362:0:7616:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x80c8383f4848fca2 00010000:00010000:0.0:1788752822.652292:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788752822.652668:0:7616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788752822.655829:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788752822.656456:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788752822.662416:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788752822.662929:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788752822.665059:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788752822.665072:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752822.665077:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752822.665080:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788752822.665084:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788752822.665088:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752822.665090:0:7616:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788752822.665093:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788752822.665095:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788752822.665285:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752822.665290:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752822.665291:0:7616:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788752822.665295:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788752822.665439:0:7609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788752822.665466:0:7609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788752822.665488:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.665499:0:7609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752822.665507:0:7609:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bafe44000 from 1 10000000:01000000:1.0:1788752822.665509:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788752822.665553:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.665560:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.665569:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.665603:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627968:0@lo:101: 00000100:00100000:1.0:1788752822.665670:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.665715:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752822.665789:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182627968 00000100:00100000:3.0:1788752822.665797:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182627968 00000100:00100000:3.0:1788752822.665846:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788752822.665855:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:7609:x1875643182627968:12345-0@lo:101: 00010000:00010000:3.0:1788752822.665869:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752822.665881:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fca9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.665904:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.665914:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752822.665922:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2cc00, rc 0) 00000100:00100000:3.0:1788752822.665960:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182627968:12345-0@lo:101: Request processed in 107us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752822.665967:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788752822.666052:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182627968:0@lo:101: 00010000:00010000:1.0:1788752822.666065:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.666074:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.666195:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628096:0@lo:501: 00000100:00100000:1.0:1788752822.666219:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.666239:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.666253:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628096 00000100:00100000:1.0:1788752822.666257:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628096 00000100:00100000:1.0:1788752822.666281:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788752822.666287:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628096:12345-0@lo:501: 00000100:00100000:1.0:1788752822.666483:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628096:12345-0@lo:501: Request processed in 195us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.666490:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788752822.666522:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628096:0@lo:501: 00000100:00100000:1.0:1788752822.666561:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628224:0@lo:503: 00000100:00100000:1.0:1788752822.666597:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.666611:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.666624:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628224 00000100:00100000:1.0:1788752822.666633:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628224 00000100:00100000:1.0:1788752822.666651:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788752822.666657:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628224:12345-0@lo:503: 00000100:00100000:1.0:1788752822.666931:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628224:12345-0@lo:503: Request processed in 273us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.666937:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788752822.666975:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628224:0@lo:503: 00000040:00080000:1.0:1788752822.667285:0:7609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788752822.667360:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628352:0@lo:502: 00000100:00100000:1.0:1788752822.667397:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.667415:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.667433:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628352 00000100:00100000:1.0:1788752822.667438:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628352 00000100:00100000:1.0:1788752822.667458:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788752822.667465:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628352:12345-0@lo:502: 00000100:00100000:1.0:1788752822.667624:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628352:12345-0@lo:502: Request processed in 158us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.667631:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788752822.667672:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628352:0@lo:502: 00000040:00080000:1.0:1788752822.667913:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788752822.667952:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788752822.667973:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628480:0@lo:502: 00000100:00100000:1.0:1788752822.668019:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.668034:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.668047:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628480 00000100:00100000:1.0:1788752822.668051:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628480 00000100:00100000:1.0:1788752822.668067:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788752822.668079:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628480:12345-0@lo:502: 00000100:00100000:1.0:1788752822.668207:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628480:12345-0@lo:502: Request processed in 128us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.668214:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788752822.668250:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628480:0@lo:502: 00000040:00080000:1.0:1788752822.668324:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788752822.668333:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788752822.673535:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788752822.673559:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752822.673562:0:7619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788752822.673569:0:7619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bafe44000 00000020:00000080:2.0:1788752822.673572:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788752822.673593:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788752822.673596:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752822.673598:0:7619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788752822.673601:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788752822.673928:0:7609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788752822.673959:0:7609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788752822.673982:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.673996:0:7609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752822.674039:0:7609:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788752822.674043:0:7609:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c9bafe44000 10000000:01000000:1.0:1788752822.674046:0:7609:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c9bafe44000 10000000:01000000:1.0:1788752822.674050:0:7609:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788752822.674055:0:7609:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9bafe44000 from 1 10000000:01000000:1.0:1788752822.674058:0:7609:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788752822.674093:0:7609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.674101:0:7609:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.674113:0:7609:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.674171:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628608:0@lo:101: 00000100:00100000:1.0:1788752822.674241:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.674282:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093900 going to sleep for 11 seconds 00000100:00100000:0.0:1788752822.675064:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628608 00000100:00100000:0.0:1788752822.675073:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628608 00000100:00100000:0.0:1788752822.675150:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788752822.675160:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182628608:12345-0@lo:101: 00010000:00010000:0.0:1788752822.675180:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752822.675196:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fcb7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.675221:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.675232:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.675240:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752822.675299:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182628608:12345-0@lo:101: Request processed in 141us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752822.675306:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788752822.675453:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628608:0@lo:101: 00010000:00010000:1.0:1788752822.675469:0:7609:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.675479:0:7609:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.675588:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628736:0@lo:501: 00000100:00100000:1.0:1788752822.675617:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.675686:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093900 going to sleep for 11 seconds 00000100:00100000:3.0:1788752822.675753:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628736 00000100:00100000:3.0:1788752822.675758:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628736 00000100:00100000:3.0:1788752822.675791:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788752822.675798:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182628736:12345-0@lo:501: 00000100:00100000:3.0:1788752822.676041:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182628736:12345-0@lo:501: Request processed in 243us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752822.676054:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788752822.676151:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628736:0@lo:501: 00000100:00100000:1.0:1788752822.676180:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628864:0@lo:503: 00000100:00100000:1.0:1788752822.676215:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.676231:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093900 going to sleep for 11 seconds 00000100:00100000:0.0:1788752822.676299:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628864 00000100:00100000:0.0:1788752822.676304:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628864 00000100:00100000:0.0:1788752822.676328:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788752822.676335:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182628864:12345-0@lo:503: 00000100:00100000:0.0:1788752822.676477:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182628864:12345-0@lo:503: Request processed in 142us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752822.676485:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788752822.676566:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628864:0@lo:503: 00000040:00080000:1.0:1788752822.676827:0:7609:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788752822.676890:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628992:0@lo:502: 00000100:00100000:1.0:1788752822.676924:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.677064:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093900 going to sleep for 11 seconds 00000100:00100000:3.0:1788752822.677337:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182628992 00000100:00100000:3.0:1788752822.677343:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182628992 00000100:00100000:3.0:1788752822.677407:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788752822.677414:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182628992:12345-0@lo:502: 00000100:00100000:3.0:1788752822.677619:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182628992:12345-0@lo:502: Request processed in 205us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752822.677625:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788752822.677700:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182628992:0@lo:502: 00000040:00080000:1.0:1788752822.677976:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788752822.678050:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788752822.678088:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788752822.678172:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788752822.678211:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788752822.678263:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788752822.678303:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788752822.678354:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788752822.678406:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788752822.678443:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788752822.678478:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788752822.678529:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788752822.678583:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788752822.678619:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788752822.678683:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788752822.678725:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788752822.678759:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788752822.678805:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788752822.678839:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788752822.678872:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788752822.678918:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788752822.678956:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788752822.678991:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788752822.679071:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788752822.679103:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788752822.679166:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788752822.679212:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788752822.679248:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788752822.679281:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788752822.679326:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788752822.679359:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788752822.679388:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788752822.679415:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788752822.679459:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788752822.679508:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788752822.679569:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788752822.679606:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788752822.679652:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182629120:0@lo:502: 00000100:00100000:1.0:1788752822.679721:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.680426:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093900 going to sleep for 11 seconds 00000100:00100000:0.0:1788752822.680495:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182629120 00000100:00100000:0.0:1788752822.680503:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182629120 00000100:00100000:0.0:1788752822.680581:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788752822.680591:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182629120:12345-0@lo:502: 00000100:00100000:0.0:1788752822.680883:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182629120:12345-0@lo:502: Request processed in 293us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752822.680897:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788752822.681096:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182629120:0@lo:502: 00000040:00080000:1.0:1788752822.681220:0:7609:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788752822.681233:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788752822.681882:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788752822.681896:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c9b88b44d40) 00000020:00000080:1.0:1788752822.681917:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788752822.682295:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bafe44000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788752822.682299:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9bafe44000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788752822.682302:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bafe44000 3 00010000:00080000:1.0:1788752822.682329:0:7621:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9bafe43000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.105@tcp at head 00010000:00010000:1.0:1788752822.685100:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788752822.685346:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788752822.685385:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788752822.685399:0:7621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x80c8383f4848fccc 00000100:00080000:1.0:1788752822.685408:0:7621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788752822.685419:0:7621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c9bafe43000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1788752822.685455:0:7621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bbe07df80 x1875643182629248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788752822.685490:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788752822.685712:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875643182629248:0@lo:38: 00000100:00100000:3.0:1788752822.685769:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.685920:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182629248 00000100:00100000:1.0:1788752822.685937:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182629248 00000100:00100000:1.0:1788752822.685992:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788752822.685999:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875643182629248:12345-0@lo:38: 00010000:00080000:1.0:1788752822.686028:0:5834:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1788752822.686057:0:5834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x80c8383f4848fcd3 00000004:00100000:1.0:1788752822.686071:0:5834:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788752822.686099:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9c9a842b0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788752822.686176:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe550700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875643182629248:12345-0@lo:38: Request processed in 175us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.686183:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788752822.686302:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788752822.686353:0:7609:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788752822.686376:0:7609:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788752822.686389:0:7609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.686399:0:7609:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788752822.686438:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788752822.686440:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788752822.686441:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788752822.686443:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788752822.686444:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788752822.686445:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788752822.686447:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788752822.686448:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788752822.686449:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788752822.686451:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788752822.686452:0:7609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788752822.686456:0:7609:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788752822.686458:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788752822.686459:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788752822.686460:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788752822.686461:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788752822.686466:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788752822.686467:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788752822.686468:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788752822.686469:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788752822.686470:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788752822.686470:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788752822.686471:0:7609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788752822.686483:0:7609:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788752822.686493:0:7609:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182629376:0@lo:253: 00000100:00100000:1.0:1788752822.686529:0:7609:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.686619:0:7609:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093cc0 going to sleep for 11 seconds 00010000:00080000:3.0:1788752822.687153:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe07df80 x1875643182629248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788752832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752822.687164:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788752822.687172:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788752822.687178:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788752822.687183:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788752822.687185:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bafe43000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788752822.687191:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875643182629248:0@lo:38: 00000100:00100000:3.0:1788752822.687242:0:7622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1875643182629504:0@lo:901: 00000100:00100000:3.0:1788752822.687267:0:7622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752822.687285:0:7622:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61900 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.687305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182629504 00000100:00100000:1.0:1788752822.687311:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182629504 00000100:00080000:3.0:1788752822.687354:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752822.687357:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788752822.687365:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1875643182629504:12345-0@lo:901: 00000100:00100000:1.0:1788752822.687714:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe552680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1875643182629504:12345-0@lo:901: Request processed in 349us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.687721:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788752822.687951:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182629376 00000100:00100000:2.0:1788752822.687958:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182629376 00010000:00080000:3.0:1788752822.688047:0:7622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bbe553100 x1875643182629504/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788752838 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752822.688058:0:7622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553100 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1875643182629504:0@lo:901: 00000100:00100000:0.0:1788752822.688329:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182629760:0@lo:400: 00000100:00100000:3.0:1788752822.688354:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182629632:0@lo:400: 00000100:00100000:3.0:1788752822.688384:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752822.688413:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182629632 00000100:00100000:3.0:1788752822.688416:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182629632 00000100:00100000:3.0:1788752822.688439:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788752822.688445:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182629632:12345-0@lo:400: 00000100:00100000:3.0:1788752822.688477:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe553100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182629632:12345-0@lo:400: Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752822.688482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788752822.688505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bae9d1180 x1875643182629632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752822.688514:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182629632:0@lo:400: 00000100:00100000:0.0:1788752822.688574:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.688598:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788752822.688603:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182629888:0@lo:400: 00000100:00100000:0.0:1788752822.688622:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752822.688672:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182629760 00000100:00100000:3.0:1788752822.688677:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182629760 00000100:00100000:3.0:1788752822.688738:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788752822.688744:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182629760:12345-0@lo:400: 00000100:00100000:2.0:1788752822.688748:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788752822.688756:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:7609:x1875643182629376:12345-0@lo:253: 20000000:01000000:2.0:1788752822.688775:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:3.0:1788752822.688778:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182629760:12345-0@lo:400: Request processed in 34us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752822.688784:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 20000000:01000000:2.0:1788752822.688788:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788752822.688811:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bae9d1c00 x1875643182629760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752822.688820:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182629760:0@lo:400: 00000100:00080000:0.0:1788752822.688851:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752822.689397:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182629888 00000100:00100000:1.0:1788752822.689403:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182629888 00000100:00100000:1.0:1788752822.689440:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788752822.689446:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182629888:12345-0@lo:400: 00000100:00100000:1.0:1788752822.689494:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182629888:12345-0@lo:400: Request processed in 49us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.689500:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788752822.689528:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788752822.689611:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bae9d0a80 x1875643182629888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752822.689622:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182629888:0@lo:400: 20000000:01000000:3.0:1788752822.714824:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788752822.714875:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788752822.716119:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788752822.716140:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788752822.716162:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.716232:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.716258:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.716374:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752822.716388:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 14 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.716402:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875643182630016:0@lo:104: 00000100:00100000:0.0:1788752822.716464:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752822.716511:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752822.716737:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630016 00000100:00100000:1.0:1788752822.716746:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630016 00000100:00100000:1.0:1788752822.716870:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788752822.716880:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5849:x1875643182630016:12345-0@lo:104: 00010000:00010000:1.0:1788752822.716894:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.716952:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788752822.716958:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+3:5849:x1875643182630016:12345-0@lo:104: Request processed in 81us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.716965:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788752822.717025:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1875643182630016:0@lo:104: 00010000:00010000:3.0:1788752822.717043:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719329:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752822.719344:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719356:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788752822.719360:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719370:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788752822.719378:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752822.719384:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788752822.719431:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719437:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788752822.719459:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719464:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fc24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc2b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752822.719471:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182630144:0@lo:103: 00010000:00010000:1.0:1788752822.719479:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752822.719481:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752822.719483:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752822.719532:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752822.719579:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630144 00000100:00100000:1.0:1788752822.719587:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630144 00010000:00010000:1.0:1788752822.719615:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 15 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752822.719693:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788752822.719700:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b98cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:3305:x1875643182630144:12345-0@lo:103: 00010000:00010000:1.0:1788752822.719710:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752822.719714:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 15 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719723:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 15 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719735:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8800/0x80c8383f4848fc2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fc24 expref: 15 pid: 5827 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719746:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719757:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788752822.719769:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003630201s 00010000:00010000:1.0:1788752822.719772:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719776:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719781:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719785:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719789:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2172400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752822.719792:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719797:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719814:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752822.719863:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752822.719938:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b98cf5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3305:x1875643182630144:12345-0@lo:103: Request processed in 239us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752822.719944:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788752822.719953:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.719964:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752822.719971:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fcda lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752822.720060:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182630144:0@lo:103: 00000100:00100000:0.0:1788752822.722465:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:7609:x1875643182629376:12345-0@lo:253: Request processed in 33701us (35926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752822.722479:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788752822.722572:0:7609:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b577cb32-91f9-472d-9b00-c1edbc016b63:7609:1875643182629376:0@lo:253: 10000000:01000000:1.0:1788752822.722588:0:7609:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788752822.722592:0:7609:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788752822.722593:0:7609:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788752822.722595:0:7609:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788752822.722596:0:7609:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788752822.722598:0:7609:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788752822.722600:0:7609:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788752822.722601:0:7609:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788752822.722603:0:7609:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788752822.722604:0:7609:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788752822.722605:0:7609:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788752822.722607:0:7609:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788752822.722619:0:7609:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788752822.727225:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788752822.727425:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788752822.727628:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788752822.727801:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788752822.727994:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788752822.728260:0:7609:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788752822.729748:0:7609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788752822.883304:0:7609:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788752822.883311:0:7609:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788752822.883347:0:7609:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788752822.883405:0:7609:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788752822.883421:0:7609:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788752822.883446:0:7609:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788752823.214887:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752824.234552:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752825.258455:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752825.520436:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182630272:0@lo:13: 00000100:00100000:0.0:1788752825.520504:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752825.520641:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630272 00000100:00100000:3.0:1788752825.520649:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630272 00000100:00100000:3.0:1788752825.520712:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788752825.520723:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182630272:12345-0@lo:13: 00002000:00000024:3.0:1788752825.520757:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752825.520817:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182630272:12345-0@lo:13: Request processed in 83us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752825.520825:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788752825.520869:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe550380 x1875643182630272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752825.520887:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182630272:0@lo:13: 00000100:00080000:0.0:1788752825.521104:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788752826.284119:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752827.308035:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752828.077873:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182630400:0@lo:400: 00000100:00100000:3.0:1788752828.077959:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752828.078018:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182630912:0@lo:400: 00000100:00100000:3.0:1788752828.078054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752828.078090:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788752828.078097:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182630528:0@lo:400: 00000100:00100000:3.0:1788752828.078149:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752828.078448:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630400 00000100:00100000:2.0:1788752828.078458:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630400 00000100:00100000:2.0:1788752828.078518:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788752828.078528:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3303:x1875643182630400:12345-0@lo:400: 00000100:00100000:2.0:1788752828.078605:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3303:x1875643182630400:12345-0@lo:400: Request processed in 78us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752828.078625:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788752828.078670:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182630784:0@lo:400: 00000100:00100000:2.0:1788752828.078702:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752828.078727:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788752828.078734:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182630656:0@lo:400: 00000100:00100000:2.0:1788752828.078790:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630784 00000100:00100000:2.0:1788752828.078794:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630784 00000100:00100000:2.0:1788752828.078832:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788752828.078840:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182630784:12345-0@lo:400: 00000100:00100000:2.0:1788752828.079081:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182630784:12345-0@lo:400: Request processed in 242us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752828.079089:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788752828.079107:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752828.079468:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182630400:0@lo:400: 00000100:00100000:2.0:1788752828.079518:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630912 00000100:00100000:2.0:1788752828.079524:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630912 00000100:00100000:2.0:1788752828.079573:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630528 00000100:00100000:2.0:1788752828.079577:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630528 00000100:00100000:2.0:1788752828.079597:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788752828.079604:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182630912:12345-0@lo:400: 00000100:00100000:3.0:1788752828.079626:0:5834:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788752828.079635:0:5834:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788752828.079748:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe553480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182630912:12345-0@lo:400: Request processed in 144us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752828.079756:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788752828.079770:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788752828.079776:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182630528:12345-0@lo:400: 00000100:00100000:2.0:1788752828.079803:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182630528:12345-0@lo:400: Request processed in 27us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752828.079809:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788752828.080372:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788752828.080411:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe552d80 x1875643182630784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752828.080422:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe552d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182630784:0@lo:400: 00000100:00080000:2.0:1788752828.080444:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752828.080463:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182630656 00000100:00100000:2.0:1788752828.080469:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182630656 00000100:00100000:2.0:1788752828.080499:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788752828.080505:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182630656:12345-0@lo:400: 00000100:00100000:2.0:1788752828.081116:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182630656:12345-0@lo:400: Request processed in 608us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752828.081153:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788752828.081193:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe550e00 x1875643182630528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752828.081204:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182630528:0@lo:400: 00010000:00080000:2.0:1788752828.081223:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe552a00 x1875643182630912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752828.081232:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182630912:0@lo:400: 00000100:00080000:2.0:1788752828.081302:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788752828.081323:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe553b80 x1875643182630656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752828.081333:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182630656:0@lo:400: 00010000:00010000:1.0:1788752828.330998:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788752829.354935:0:7965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788752829.355854:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752830.383504:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752830.634439:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788752830.634463:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182631040:0@lo:13: 00000100:00100000:0.0:1788752830.634547:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752830.634708:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631040 00000100:00100000:3.0:1788752830.634716:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631040 00000100:00100000:3.0:1788752830.634782:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788752830.634792:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182631040:12345-0@lo:13: 00002000:00000024:3.0:1788752830.634829:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752830.634889:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182631040:12345-0@lo:13: Request processed in 99us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752830.634897:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788752830.634938:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe550380 x1875643182631040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752830.634956:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182631040:0@lo:13: 00000100:00080000:0.0:1788752830.635070:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788752831.402223:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788752831.659074:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788752831.659083:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9bbd907800 from 30 10000000:01000000:0.0:1788752831.659089:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788752831.659420:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.659507:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.659520:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752831.659545:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631168:0@lo:101: 00000100:00100000:0.0:1788752831.659711:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752831.659830:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b38000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.660312:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631168 00000100:00100000:3.0:1788752831.660320:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631168 00000100:00100000:3.0:1788752831.660381:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788752831.660391:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182631168:12345-0@lo:101: 00010000:00010000:3.0:1788752831.660403:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752831.660535:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fce1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.660562:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.660573:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.660598:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ca00, rc 0) 00000100:00100000:3.0:1788752831.660650:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182631168:12345-0@lo:101: Request processed in 261us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.660657:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788752831.660708:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631168:0@lo:101: 00010000:00010000:0.0:1788752831.660725:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.660734:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752831.660802:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631296:0@lo:501: 00000100:00100000:0.0:1788752831.660831:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.660892:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631296 00000100:00100000:2.0:1788752831.660898:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631296 00000100:00100000:2.0:1788752831.660931:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788752831.660938:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182631296:12345-0@lo:501: 00000100:00100000:0.0:1788752831.661029:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b38000 going to sleep for 11 seconds 00000100:00100000:2.0:1788752831.661375:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182631296:12345-0@lo:501: Request processed in 436us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.661382:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788752831.662085:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631296:0@lo:501: 00000100:00100000:0.0:1788752831.662143:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631424:0@lo:503: 00000100:00100000:0.0:1788752831.662201:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752831.662239:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b38000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.662477:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631424 00000100:00100000:3.0:1788752831.662491:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631424 00000100:00100000:3.0:1788752831.662529:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788752831.662537:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182631424:12345-0@lo:503: 00000100:00100000:3.0:1788752831.662858:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182631424:12345-0@lo:503: Request processed in 321us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.662866:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788752831.662965:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631424:0@lo:503: 00000100:00100000:0.0:1788752831.663654:0:8070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8070:1875643182631552:0@lo:502: 00000100:00100000:0.0:1788752831.663701:0:8070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752831.663736:0:8070:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b38000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.663792:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631552 00000100:00100000:3.0:1788752831.663798:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631552 00000100:00100000:3.0:1788752831.663863:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788752831.663870:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8070:x1875643182631552:12345-0@lo:502: 00000100:00100000:3.0:1788752831.664154:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8070:x1875643182631552:12345-0@lo:502: Request processed in 283us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.664161:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788752831.664250:0:8070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8070:1875643182631552:0@lo:502: 00000100:00100000:1.0:1788752831.664295:0:8070:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8070:1875643182631680:0@lo:502: 00000100:00100000:1.0:1788752831.664334:0:8070:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.669620:0:8070:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b38000 going to sleep for 11 seconds 00000100:00100000:0.0:1788752831.670670:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631680 00000100:00100000:0.0:1788752831.670681:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631680 00000100:00100000:0.0:1788752831.670739:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788752831.670750:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8070:x1875643182631680:12345-0@lo:502: 00000100:00100000:0.0:1788752831.672642:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8070:x1875643182631680:12345-0@lo:502: Request processed in 1886us (8299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752831.672655:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788752831.672780:0:8070:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8070:1875643182631680:0@lo:502: 00000040:00080000:1.0:1788752831.672819:0:8070:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788752831.676139:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788752831.676190:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788752831.676204:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.676217:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752831.676245:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788752831.676248:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788752831.676251:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788752831.676287:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.676295:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.676305:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752831.676328:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631808:0@lo:101: 00000100:00100000:0.0:1788752831.676737:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752831.676789:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b90965c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.676900:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631808 00000100:00100000:3.0:1788752831.676908:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631808 00000100:00100000:3.0:1788752831.676962:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788752831.676971:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182631808:12345-0@lo:101: 00010000:00010000:3.0:1788752831.676994:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752831.677008:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fcef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.677043:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fcef expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.677053:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fcef expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.677061:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d600, rc 0) 00000100:00100000:3.0:1788752831.677114:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182631808:12345-0@lo:101: Request processed in 144us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.677146:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788752831.677322:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631808:0@lo:101: 00010000:00010000:1.0:1788752831.677339:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752831.677359:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752831.677420:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631936:0@lo:501: 00000100:00100000:1.0:1788752831.677457:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.677475:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9b686540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752831.677622:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182631936 00000100:00100000:0.0:1788752831.677627:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182631936 00000100:00100000:0.0:1788752831.677648:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788752831.677654:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182631936:12345-0@lo:501: 00000100:00100000:0.0:1788752831.679193:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182631936:12345-0@lo:501: Request processed in 1529us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752831.679204:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788752831.682228:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182631936:0@lo:501: 00000100:00100000:1.0:1788752831.682297:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632064:0@lo:503: 00000100:00100000:1.0:1788752831.682505:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.682590:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9b686540 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.684289:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632064 00000100:00100000:3.0:1788752831.684304:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632064 00000100:00100000:3.0:1788752831.684501:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788752831.684512:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182632064:12345-0@lo:503: 00000100:00100000:3.0:1788752831.685456:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182632064:12345-0@lo:503: Request processed in 942us (2947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.685466:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788752831.686700:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632064:0@lo:503: 00000100:00100000:1.0:1788752831.688108:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8071:1875643182632192:0@lo:502: 00000100:00100000:1.0:1788752831.688217:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.688261:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9b686540 going to sleep for 11 seconds 00000100:00100000:2.0:1788752831.689002:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632192 00000100:00100000:2.0:1788752831.689012:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632192 00000100:00100000:2.0:1788752831.689068:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788752831.689079:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8071:x1875643182632192:12345-0@lo:502: 00000100:00100000:2.0:1788752831.689386:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8071:x1875643182632192:12345-0@lo:502: Request processed in 308us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.689395:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788752831.690229:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8071:1875643182632192:0@lo:502: 00000020:01000000:1.0:1788752831.690268:0:8071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788752831.690278:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788752831.690280:0:8071:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788752831.690285:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788752831.690287:0:8071:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788752831.690315:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8071:1875643182632320:0@lo:502: 00000100:00100000:1.0:1788752831.690376:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.690422:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baed32840 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.690848:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632320 00000100:00100000:3.0:1788752831.690854:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632320 00000100:00100000:3.0:1788752831.690900:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788752831.690908:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8071:x1875643182632320:12345-0@lo:502: 00000100:00100000:3.0:1788752831.691100:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8071:x1875643182632320:12345-0@lo:502: Request processed in 192us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.691108:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788752831.691366:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8071:1875643182632320:0@lo:502: 00000020:01000000:1.0:1788752831.691389:0:8071:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788752831.691395:0:8071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788752831.691397:0:8071:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788752831.691400:0:8071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788752831.692559:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788752831.692582:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788752831.692594:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.692605:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752831.692624:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788752831.692627:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9b90a5a800 from 30 10000000:01000000:0.0:1788752831.692630:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788752831.692660:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.692668:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752831.692678:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752831.692693:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632448:0@lo:101: 00000100:00100000:0.0:1788752831.692736:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752831.692774:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b90965c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788752831.692843:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632448 00000100:00100000:2.0:1788752831.692850:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632448 00000100:00100000:2.0:1788752831.692887:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788752831.692896:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182632448:12345-0@lo:101: 00010000:00010000:2.0:1788752831.692908:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752831.692920:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fcfd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.692941:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.692952:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.692960:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929400, rc 0) 00000100:00100000:2.0:1788752831.693005:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182632448:12345-0@lo:101: Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.693011:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788752831.693094:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632448:0@lo:101: 00010000:00010000:1.0:1788752831.693107:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752831.693163:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752831.693214:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632576:0@lo:501: 00000100:00100000:1.0:1788752831.693243:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.693272:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9b686540 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.693300:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632576 00000100:00100000:3.0:1788752831.693305:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632576 00000100:00100000:3.0:1788752831.693325:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788752831.693338:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182632576:12345-0@lo:501: 00000100:00100000:3.0:1788752831.693581:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182632576:12345-0@lo:501: Request processed in 243us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.693588:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788752831.693660:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632576:0@lo:501: 00000100:00100000:1.0:1788752831.693686:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632704:0@lo:503: 00000100:00100000:1.0:1788752831.693720:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.693743:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9b686540 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.694363:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632704 00000100:00100000:3.0:1788752831.694371:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632704 00000100:00100000:3.0:1788752831.694405:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788752831.694412:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182632704:12345-0@lo:503: 00000100:00100000:3.0:1788752831.694586:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182632704:12345-0@lo:503: Request processed in 174us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.694593:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788752831.694713:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182632704:0@lo:503: 00000100:00100000:1.0:1788752831.695425:0:8072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8072:1875643182632832:0@lo:502: 00000100:00100000:1.0:1788752831.695469:0:8072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.695510:0:8072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0ed5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.695559:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632832 00000100:00100000:3.0:1788752831.695565:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632832 00000100:00100000:3.0:1788752831.695597:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788752831.695605:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8072:x1875643182632832:12345-0@lo:502: 00000100:00100000:3.0:1788752831.695911:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8072:x1875643182632832:12345-0@lo:502: Request processed in 306us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.695918:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788752831.695996:0:8072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8072:1875643182632832:0@lo:502: 00000100:00100000:1.0:1788752831.696038:0:8072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8072:1875643182632960:0@lo:502: 00000100:00100000:1.0:1788752831.696069:0:8072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.696091:0:8072:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9b686540 going to sleep for 11 seconds 00000100:00100000:2.0:1788752831.696162:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182632960 00000100:00100000:2.0:1788752831.696167:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182632960 00000100:00100000:2.0:1788752831.696193:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788752831.696199:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8072:x1875643182632960:12345-0@lo:502: 00000100:00100000:2.0:1788752831.696347:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8072:x1875643182632960:12345-0@lo:502: Request processed in 147us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.696354:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788752831.696617:0:8072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8072:1875643182632960:0@lo:502: 00000040:00080000:1.0:1788752831.696636:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788752831.696977:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788752831.696994:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788752831.697005:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.697015:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752831.697024:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788752831.697027:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9b90a5a800 from 5 10000000:01000000:2.0:1788752831.697029:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788752831.697108:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.697351:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.697362:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752831.697378:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633088:0@lo:101: 00000100:00100000:2.0:1788752831.697416:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.697478:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752831.698400:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633088 00000100:00100000:1.0:1788752831.698410:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633088 00000100:00100000:1.0:1788752831.698508:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788752831.698517:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182633088:12345-0@lo:101: 00010000:00010000:1.0:1788752831.698542:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752831.698559:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173200/0x80c8383f4848fd12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fd0b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752831.698582:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173200/0x80c8383f4848fd12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fd0b expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752831.698592:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2173200/0x80c8383f4848fd12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fd0b expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752831.698601:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173200, rc 0) 00000100:00100000:1.0:1788752831.698656:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182633088:12345-0@lo:101: Request processed in 140us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752831.698663:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788752831.698749:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633088:0@lo:101: 00010000:00010000:2.0:1788752831.698764:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.698783:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752831.698835:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633216:0@lo:256: 00000100:00100000:2.0:1788752831.698869:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.700019:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.700203:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633216 00000100:00100000:3.0:1788752831.700264:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633216 00000100:00100000:3.0:1788752831.700298:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788752831.700305:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182633216:12345-0@lo:256: 20000000:01000000:3.0:1788752831.700323:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788752831.700345:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788752831.700348:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788752831.700540:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182633216:12345-0@lo:256: Request processed in 235us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.700555:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788752831.700678:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633216:0@lo:256: 10000000:01000000:2.0:1788752831.700873:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788752831.700883:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.700893:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752831.700902:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788752831.700904:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788752831.700906:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788752831.700930:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.700937:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.700946:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752831.700959:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633344:0@lo:101: 00000100:00100000:2.0:1788752831.700993:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.701020:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.701295:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633344 00000100:00100000:3.0:1788752831.701301:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633344 00000100:00100000:3.0:1788752831.701409:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788752831.701416:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182633344:12345-0@lo:101: 00010000:00010000:3.0:1788752831.701427:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752831.701438:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fd19 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.701457:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.701466:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.701475:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ce00, rc 0) 00000100:00100000:3.0:1788752831.701521:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182633344:12345-0@lo:101: Request processed in 105us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.701527:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788752831.701614:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633344:0@lo:101: 00010000:00010000:2.0:1788752831.701626:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752831.701633:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752831.701678:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633472:0@lo:501: 00000100:00100000:2.0:1788752831.701700:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.701988:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752831.702020:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633472 00000100:00100000:1.0:1788752831.702025:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633472 00000100:00100000:1.0:1788752831.702047:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788752831.702052:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182633472:12345-0@lo:501: 00000100:00100000:2.0:1788752831.702663:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633472:0@lo:501: 00000100:00100000:2.0:1788752831.702697:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633600:0@lo:503: 00000100:00100000:2.0:1788752831.702960:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.702979:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752831.703021:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182633472:12345-0@lo:501: Request processed in 431us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752831.703029:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788752831.703053:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633600 00000100:00100000:1.0:1788752831.703067:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633600 00000100:00100000:1.0:1788752831.703088:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788752831.703094:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182633600:12345-0@lo:503: 00000100:00100000:1.0:1788752831.706373:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182633600:12345-0@lo:503: Request processed in 3272us (3406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752831.706384:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788752831.706817:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182633600:0@lo:503: 00000100:00100000:2.0:1788752831.707906:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8073:1875643182633728:0@lo:502: 00000100:00100000:2.0:1788752831.707969:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.708042:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752831.708207:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633728 00000100:00100000:0.0:1788752831.708278:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633728 00000100:00100000:1.0:1788752831.708359:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788752831.708371:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8073:x1875643182633728:12345-0@lo:502: 00000100:00100000:1.0:1788752831.708664:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8073:x1875643182633728:12345-0@lo:502: Request processed in 296us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752831.708672:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788752831.708890:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8073:1875643182633728:0@lo:502: 00000020:01000000:2.0:1788752831.708918:0:8073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788752831.708926:0:8073:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788752831.708932:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752831.708934:0:8073:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788752831.708940:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788752831.708948:0:8073:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000020:01000000:2.0:1788752831.708969:0:8073:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788752831.708972:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788752831.708985:0:8073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c9ba0064d40) 00000020:00000080:2.0:1788752831.709006:0:8073:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788752831.709011:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788752831.709092:0:8073:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788752831.709098:0:8073:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788752831.709367:0:8073:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f4848fd2e 00010000:00080000:2.0:1788752831.709402:0:8073:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9b9149a800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:2.0:1788752831.709634:0:8073:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1788752831.711843:0:8073:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788752831.711862:0:8073:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788752831.712788:0:8073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788752831.712985:0:8073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788752831.713033:0:8073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788752831.714045:0:8073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788752831.716846:0:8074:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752831.716856:0:8074:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788752831.717720:0:8073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788752831.717732:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788752831.717769:0:8073:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788752831.717793:0:8073:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f4848fd35 00000100:00080000:3.0:1788752831.717804:0:8073:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788752831.717815:0:8073:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c9b9149a800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1788752831.717854:0:8073:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bbe550380 x1875643182633856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788752831.717886:0:8073:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788752831.717947:0:8073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752831.717952:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752831.717954:0:8073:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788752831.717957:0:8073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752831.717961:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752831.717962:0:8073:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788752831.717965:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788752831.717967:0:8073:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788752831.717994:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8073:1875643182633984:0@lo:502: 00000100:00100000:2.0:1788752831.718222:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182634112:0@lo:400: 00000100:00100000:2.0:1788752831.718261:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.718295:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788752831.718302:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182634240:0@lo:400: 00000100:00100000:2.0:1788752831.718322:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.718350:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b8733aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182634368:0@lo:400: 00000100:00100000:2.0:1788752831.718374:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.718395:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788752831.718401:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182634496:0@lo:400: 00000100:00100000:2.0:1788752831.718422:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.718451:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182634112 00000100:00100000:2.0:1788752831.718457:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182634112 00000100:00100000:2.0:1788752831.718519:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182634240 00000100:00100000:2.0:1788752831.718523:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182634240 00000100:00100000:2.0:1788752831.718546:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182634496 00000100:00100000:2.0:1788752831.718549:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182634496 00000100:00100000:2.0:1788752831.718565:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788752831.718572:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182634112:12345-0@lo:400: 00000100:00100000:2.0:1788752831.718620:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182634112:12345-0@lo:400: Request processed in 48us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.718627:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788752831.718642:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788752831.718648:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182634240:12345-0@lo:400: 00000100:00100000:2.0:1788752831.718674:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182634240:12345-0@lo:400: Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.718680:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788752831.718691:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788752831.718697:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182634496:12345-0@lo:400: 00000100:00100000:2.0:1788752831.718726:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182634496:12345-0@lo:400: Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.718731:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788752831.718755:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788752831.718778:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b87338e00 x1875643182634496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752831.718789:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182634496:0@lo:400: 00010000:00080000:2.0:1788752831.718815:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b87338380 x1875643182634240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752831.718824:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182634240:0@lo:400: 00010000:00080000:2.0:1788752831.718846:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b87339880 x1875643182634112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788752847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752831.718854:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182634112:0@lo:400: 00000100:00100000:3.0:1788752831.719182:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752831.719213:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baedf8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788752831.719277:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182633856:0@lo:8: 00000100:00100000:0.0:1788752831.719311:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.719393:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633984 00000100:00100000:2.0:1788752831.719398:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633984 00000100:00100000:2.0:1788752831.719435:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788752831.719441:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8073:x1875643182633984:12345-0@lo:502: 00000100:00100000:2.0:1788752831.719662:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8073:x1875643182633984:12345-0@lo:502: Request processed in 220us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752831.719669:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788752831.720277:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182634368 00000100:00100000:3.0:1788752831.720284:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182634368 00000100:00100000:3.0:1788752831.720326:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182633856 00000100:00100000:3.0:1788752831.720329:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182633856 00000100:00100000:3.0:1788752831.720341:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788752831.720348:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182634368:12345-0@lo:400: 00000100:00100000:3.0:1788752831.720404:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182634368:12345-0@lo:400: Request processed in 57us (2029us total) trans 0 rc 0/0 00010000:00080000:0.0:1788752831.720525:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b8733aa00 x1875643182634368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752831.720537:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b8733aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182634368:0@lo:400: 00000100:00100000:3.0:1788752831.720588:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788752831.720604:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788752831.720608:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1875643182633856:12345-0@lo:8: 00010000:00080000:3.0:1788752831.720632:0:6690:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:3.0:1788752831.720658:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f4848fd3c 00002000:00100000:3.0:1788752831.720671:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c9b88ac6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788752831.720675:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788752831.720679:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788752831.720803:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788752831.720959:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788752831.720980:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9c9b88ac4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752831.721083:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875643182633856:12345-0@lo:8: Request processed in 473us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.721089:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788752831.721253:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8073:1875643182633984:0@lo:502: 00000020:01000000:3.0:1788752831.721287:0:8073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752831.721293:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752831.721296:0:8073:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788752831.721300:0:8073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788752831.721356:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788752831.721372:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788752831.721381:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.721391:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752831.721402:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788752831.721405:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c9b8731b380 from 1 10000000:01000000:3.0:1788752831.721407:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788752831.721446:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.721453:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.721462:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752831.721478:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182634624:0@lo:101: 00000100:00100000:3.0:1788752831.721528:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752831.721553:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.721569:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182634624 00000100:00100000:3.0:1788752831.721574:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182634624 00000100:00100000:3.0:1788752831.721600:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788752831.721607:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182634624:12345-0@lo:101: 00010000:00010000:3.0:1788752831.721617:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752831.721629:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fd43 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.721648:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.721657:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.721666:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2de00, rc 0) 00000100:00100000:3.0:1788752831.721693:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182634624:12345-0@lo:101: Request processed in 87us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.721699:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788752831.721720:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182634624:0@lo:101: 00010000:00010000:3.0:1788752831.721731:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.721739:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752831.721774:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182634752:0@lo:501: 00000100:00100000:3.0:1788752831.721806:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752831.721819:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.721831:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182634752 00000100:00100000:3.0:1788752831.721834:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182634752 00000100:00100000:3.0:1788752831.721848:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788752831.721853:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182634752:12345-0@lo:501: 00000100:00100000:3.0:1788752831.722033:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182634752:12345-0@lo:501: Request processed in 179us (225us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788752831.722040:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788752831.722662:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182634752:0@lo:501: 10000000:01000000:3.0:1788752831.722686:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788752831.722692:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752831.722700:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788752831.723255:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe550380 x1875643182633856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788752841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752831.723265:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788752831.723282:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788752831.723289:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788752831.723296:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788752831.723299:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b9149a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788752831.723326:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788752831.723332:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe550380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182633856:0@lo:8: 00000004:00080000:3.0:1788752831.723580:0:8074:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788752831.723672:0:8074:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 231457548419ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788752831.765107:0:8075:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788752831.765171:0:8075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635008:0@lo:7: 00000100:00100000:3.0:1788752831.765239:0:8075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752831.765275:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635008 00000100:00100000:3.0:1788752831.765282:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635008 00000100:00100000:3.0:1788752831.765338:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788752831.765361:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875643182635008:12345-0@lo:7: 00000100:00100000:0.0:1788752831.767187:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182634880:0@lo:13: 00000100:00100000:0.0:1788752831.767253:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752831.767350:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182634880 00000100:00100000:0.0:1788752831.767359:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182634880 00000100:00100000:0.0:1788752831.767402:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788752831.767780:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875643182634880:12345-0@lo:13: 00002000:00000024:0.0:1788752831.767810:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788752831.767861:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875643182634880:12345-0@lo:13: Request processed in 451us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752831.767868:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788752831.767910:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe553800 x1875643182634880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752831.767929:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe553800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182634880:0@lo:13: 00000004:00080000:1.0:1788752831.768543:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788752831.769505:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752831.773556:0:8075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812f9c0 going to sleep for 11 seconds 00002000:00080000:3.0:1788752831.774656:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788752831.774669:0:6690:0:(ofd_dev.c:1210:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788752831.774770:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875643182635008:12345-0@lo:7: Request processed in 9408us (9528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752831.774780:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788752831.775013:0:8075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe551180 x1875643182635008/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788752847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752831.775028:0:8075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635008:0@lo:7: 00000004:00080000:2.0:1788752831.775042:0:8075:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788752831.775092:0:8075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635136:0@lo:5: 00000100:00100000:2.0:1788752831.775162:0:8075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.775194:0:8075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752831.775322:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635136 00000100:00100000:1.0:1788752831.775329:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635136 00000100:00100000:1.0:1788752831.775377:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788752831.775386:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8075:x1875643182635136:12345-0@lo:5: 00002000:00080000:1.0:1788752831.775420:0:6691:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788752831.775424:0:6691:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788752831.775679:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8075:x1875643182635136:12345-0@lo:5: Request processed in 293us (515us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788752831.775686:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788752831.776015:0:8075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b87339880 x1875643182635136/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788752847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752831.776028:0:8075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87339880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635136:0@lo:5: 00000004:00080000:3.0:1788752831.776039:0:8075:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788752831.776068:0:8075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635264:0@lo:700: 00000100:00100000:3.0:1788752831.776097:0:8075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752831.776146:0:8075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba00b7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788752831.776317:0:6884:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635264 00000100:00100000:1.0:1788752831.776323:0:6884:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635264 00000100:00100000:1.0:1788752831.776360:0:6884:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788752831.776368:0:6884:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8075:x1875643182635264:12345-0@lo:700: 00000100:00100000:1.0:1788752831.776400:0:6884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6884:1875643182635392:0@lo:700: 00000100:00100000:1.0:1788752831.776537:0:6884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752831.776562:0:6884:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0ed50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752831.776623:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635392 00000100:00100000:2.0:1788752831.776628:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635392 00000100:00100000:2.0:1788752831.776662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788752831.776669:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6884:x1875643182635392:12345-0@lo:700: 40000000:02000000:0.0:1788752831.803666:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788752831.808239:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6884:x1875643182635392:12345-0@lo:700: Request processed in 31559us (31689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752831.808273:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788752831.808646:0:6884:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe07fb80 x1875643182635392/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788752847 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752831.808662:0:6884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6884:1875643182635392:0@lo:700: 40000000:02000000:1.0:1788752831.808676:0:6884:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788752831.869071:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788752831.869094:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788752831.869594:0:6884:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe553800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8075:x1875643182635264:12345-0@lo:700: Request processed in 93222us (93492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752831.869618:0:6884:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788752831.869696:0:8075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe551180 x1875643182635264/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788752847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752831.869778:0:8075:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788752831.869796:0:8075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635264:0@lo:700: 00000004:02000040:3.0:1788752831.896560:0:8075:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1788752831.901886:0:8075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635520:0@lo:5: 00000100:00100000:2.0:1788752831.901965:0:8075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752831.902068:0:8075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752831.902211:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635520 00000100:00100000:3.0:1788752831.902219:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635520 00000100:00100000:3.0:1788752831.902319:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788752831.902329:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8075:x1875643182635520:12345-0@lo:5: 00002000:00080000:2.0:1788752831.908452:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788752831.908473:0:6690:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788752831.911461:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8075:x1875643182635520:12345-0@lo:5: Request processed in 9127us (9489us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788752831.911474:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788752831.911692:0:8075:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b87338e00 x1875643182635520/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788752847 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752831.911738:0:8075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8075:1875643182635520:0@lo:5: 00000004:00080000:0.0:1788752831.911754:0:8075:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788752832.427029:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752833.450487:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788752833.954524:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788752834.441706:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.441866:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164786816 00000100:00100000:3.0:1788752834.441881:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164786816 00000100:00100000:3.0:1788752834.441941:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:3.0:1788752834.441952:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875643164786816:12345-192.168.203.5@tcp:250: 00010000:00080000:3.0:1788752834.441988:0:5825:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from e1aa3116-88bb-4258-bb6d-88e2aff8c3a6@192.168.203.5@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1788752834.442047:0:5825:0:(genops.c:1384:class_connect()) connect: client e1aa3116-88bb-4258-bb6d-88e2aff8c3a6, cookie 0x80c8383f4848fd51 00000100:00080000:3.0:1788752834.442242:0:5825:0:(import.c:65:import_set_state_nolock()) ffff9c9b88ac5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752834.442309:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+5:2357:x1875643164786816:12345-192.168.203.5@tcp:250: Request processed in 360us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752834.442316:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:3.0:1788752834.456951:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.456999:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164786944 00000100:00100000:3.0:1788752834.457012:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164786944 00000100:00100000:3.0:1788752834.457071:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:3.0:1788752834.457082:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+5:5584:x1875643164786944:12345-192.168.203.5@tcp:101: 00010000:00010000:3.0:1788752834.457193:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752834.457218:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee17 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752834.457256:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752834.457270:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 6 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752834.457281:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2c800, rc 0) 00000100:00100000:3.0:1788752834.457349:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+6:5584:x1875643164786944:12345-192.168.203.5@tcp:101: Request processed in 268us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752834.457358:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 111 00010000:00010000:1.0:1788752834.476276:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752834.479191:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752834.481557:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787072 00000100:00100000:0.0:1788752834.481574:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787072 00000100:00100000:0.0:1788752834.481649:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:0.0:1788752834.481666:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+6:5584:x1875643164787072:12345-192.168.203.5@tcp:501: 00000100:00100000:0.0:1788752834.483186:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+6:5584:x1875643164787072:12345-192.168.203.5@tcp:501: Request processed in 1516us (3997us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788752834.483202:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:0.0:1788752834.488941:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.489040:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787200 00000100:00100000:3.0:1788752834.489175:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787200 00000100:00100000:1.0:1788752834.489357:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:1.0:1788752834.489372:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+6:5584:x1875643164787200:12345-192.168.203.5@tcp:101: 00010000:00010000:1.0:1788752834.489396:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752834.489421:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee1e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752834.489456:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752834.490977:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752834.490989:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173000, rc 0) 00000100:00100000:1.0:1788752834.491092:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+7:5584:x1875643164787200:12345-192.168.203.5@tcp:101: Request processed in 1723us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752834.491102:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:0.0:1788752834.493832:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752834.493915:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787328 00000100:00100000:1.0:1788752834.493929:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787328 00000100:00100000:1.0:1788752834.493994:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:1.0:1788752834.494005:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+7:5584:x1875643164787328:12345-192.168.203.5@tcp:501: 00000100:00100000:1.0:1788752834.494403:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5584:x1875643164787328:12345-192.168.203.5@tcp:501: Request processed in 398us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752834.494424:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:2.0:1788752834.499106:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752834.499257:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787456 00000100:00100000:1.0:1788752834.499271:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787456 00000100:00100000:1.0:1788752834.499352:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:1.0:1788752834.499364:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5584:x1875643164787456:12345-192.168.203.5@tcp:503: 00000100:00100000:1.0:1788752834.501387:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5584:x1875643164787456:12345-192.168.203.5@tcp:503: Request processed in 2013us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752834.501402:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:1.0:1788752834.508395:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752834.508526:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787584 00000100:00100000:0.0:1788752834.508539:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787584 00000100:00100000:0.0:1788752834.508643:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:0.0:1788752834.508655:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5602:x1875643164787584:12345-192.168.203.5@tcp:502: 00000100:00100000:0.0:1788752834.509033:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5602:x1875643164787584:12345-192.168.203.5@tcp:502: Request processed in 378us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752834.509042:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:0.0:1788752834.532113:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752834.533321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787712 00000100:00100000:1.0:1788752834.533335:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787712 00000100:00100000:2.0:1788752834.533460:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:2.0:1788752834.533481:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5602:x1875643164787712:12345-192.168.203.5@tcp:502: 00000100:00100000:2.0:1788752834.533814:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5602:x1875643164787712:12345-192.168.203.5@tcp:502: Request processed in 334us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752834.533822:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:3.0:1788752834.541057:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752834.541322:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787840 00000100:00100000:1.0:1788752834.541336:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787840 00000100:00100000:1.0:1788752834.541399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:1.0:1788752834.541409:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5584:x1875643164787840:12345-192.168.203.5@tcp:101: 00010000:00010000:1.0:1788752834.541432:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752834.541455:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fd66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee48 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752834.541501:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee48 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752834.541514:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fd66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee48 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752834.541525:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2172400, rc 0) 00000100:00100000:1.0:1788752834.541596:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5584:x1875643164787840:12345-192.168.203.5@tcp:101: Request processed in 188us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752834.541604:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:1.0:1788752834.559759:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.559850:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164787968 00000100:00100000:3.0:1788752834.559879:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164787968 00000100:00100000:3.0:1788752834.559948:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:3.0:1788752834.559961:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5584:x1875643164787968:12345-192.168.203.5@tcp:256: 20000000:01000000:3.0:1788752834.559998:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788752834.560018:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788752834.560022:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788752834.560026:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788752834.560029:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788752834.562948:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5584:x1875643164787968:12345-192.168.203.5@tcp:256: Request processed in 2976us (3188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752834.562965:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:3.0:1788752834.567796:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752834.568178:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788096 00000100:00100000:2.0:1788752834.568191:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788096 00000100:00100000:2.0:1788752834.568254:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:2.0:1788752834.568265:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5584:x1875643164788096:12345-192.168.203.5@tcp:101: 00010000:00010000:2.0:1788752834.568285:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752834.568308:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee4f expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752834.568341:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752834.568354:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752834.568387:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929a00, rc 0) 00000100:00100000:2.0:1788752834.568449:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5584:x1875643164788096:12345-192.168.203.5@tcp:101: Request processed in 186us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752834.568456:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:1.0:1788752834.570963:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.571292:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788224 00000100:00100000:3.0:1788752834.571303:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788224 00000100:00100000:3.0:1788752834.571360:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:3.0:1788752834.571370:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5584:x1875643164788224:12345-192.168.203.5@tcp:501: 00000100:00100000:3.0:1788752834.571719:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5584:x1875643164788224:12345-192.168.203.5@tcp:501: Request processed in 348us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752834.571728:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:2.0:1788752834.573627:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.573703:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788352 00000100:00100000:3.0:1788752834.573715:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788352 00000100:00100000:3.0:1788752834.573774:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:3.0:1788752834.573785:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5584:x1875643164788352:12345-192.168.203.5@tcp:503: 00000100:00100000:2.0:1788752834.575046:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5584:x1875643164788352:12345-192.168.203.5@tcp:503: Request processed in 1254us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752834.575060:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:2.0:1788752834.595805:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752834.595849:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788480 00000100:00100000:2.0:1788752834.595861:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788480 00000100:00100000:2.0:1788752834.595921:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:2.0:1788752834.595932:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5606:x1875643164788480:12345-192.168.203.5@tcp:502: 00000100:00100000:2.0:1788752834.596298:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5606:x1875643164788480:12345-192.168.203.5@tcp:502: Request processed in 366us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752834.596307:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:2.0:1788752834.600624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.600722:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788608 00000100:00100000:3.0:1788752834.600735:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788608 00000100:00100000:3.0:1788752834.600803:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:3.0:1788752834.600816:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5606:x1875643164788608:12345-192.168.203.5@tcp:502: 00000100:00100000:3.0:1788752834.601410:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5606:x1875643164788608:12345-192.168.203.5@tcp:502: Request processed in 594us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752834.601420:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:2.0:1788752834.608541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752834.608694:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788736 00000100:00100000:3.0:1788752834.608707:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788736 00000100:00100000:3.0:1788752834.608791:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:3.0:1788752834.608800:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875643164788736:12345-192.168.203.5@tcp:38: 00010000:00080000:3.0:1788752834.608836:0:5835:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1788752834.608898:0:5835:0:(genops.c:1384:class_connect()) connect: client 240b527c-392e-42d3-b78c-b594aea00353, cookie 0x80c8383f4848fd74 00000004:00100000:3.0:1788752834.608936:0:5835:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788752834.608943:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788752834.652740:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9c9b88ac3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752834.652835:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2357:x1875643164788736:12345-192.168.203.5@tcp:38: Request processed in 44032us (44304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752834.652847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00010000:00010000:3.0:1788752835.498641:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752835.660956:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752835.661058:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752835.669476:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788864 00000100:00100000:2.0:1788752835.669494:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788864 00000100:00100000:3.0:1788752835.670661:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164788992 00000100:00100000:3.0:1788752835.670674:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164788992 00000100:00080000:0.0:1788752835.670972:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752835.671220:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1788752835.671237:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+7:0:x1875643164788864:12345-192.168.203.5@tcp:41: 00000004:00000024:2.0:1788752835.671908:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788752835.672729:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+7:0:x1875643164788864:12345-192.168.203.5@tcp:41: Request processed in 1487us (11774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752835.672761:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1788752835.672811:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788752835.672823:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:5584:x1875643164788992:12345-192.168.203.5@tcp:41: 00000004:00000024:2.0:1788752835.673046:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788752835.673076:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:5584:x1875643164788992:12345-192.168.203.5@tcp:41: Request processed in 257us (12018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752835.673083:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788752835.682436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752835.682662:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164789120 00000100:00100000:1.0:1788752835.682675:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164789120 00000100:00100000:1.0:1788752835.682757:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1788752835.682770:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:5584:x1875643164789120:12345-192.168.203.5@tcp:40: 00000100:00100000:1.0:1788752835.682954:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:5584:x1875643164789120:12345-192.168.203.5@tcp:40: Request processed in 186us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752835.682965:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:0.0:1788752835.687437:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752835.687607:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752835.687851:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164789248 00000100:00100000:3.0:1788752835.687866:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164789248 00000100:00100000:3.0:1788752835.687922:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788752835.687932:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875643164789248:12345-192.168.203.5@tcp:8: 00010000:00080000:3.0:1788752835.687970:0:6688:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:3.0:1788752835.688015:0:6688:0:(genops.c:1384:class_connect()) connect: client 240b527c-392e-42d3-b78c-b594aea00353, cookie 0x80c8383f4848fd7b 00002000:00100000:3.0:1788752835.688030:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 240b527c-392e-42d3-b78c-b594aea00353/ffff9c9bb5101800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788752835.688309:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788752835.688846:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788752835.688888:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5102800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752835.689039:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2357:x1875643164789248:12345-192.168.203.5@tcp:8: Request processed in 1105us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752835.689059:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1788752835.689282:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164789504 00000100:00100000:2.0:1788752835.689291:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164789504 00000100:00100000:2.0:1788752835.689348:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:2.0:1788752835.689419:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+6:5584:x1875643164789504:12345-192.168.203.5@tcp:33: 00000100:00100000:1.0:1788752835.691769:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752835.691925:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752835.691958:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164789376 00000100:00100000:1.0:1788752835.691970:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164789376 00000100:00100000:1.0:1788752835.692005:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1788752835.692013:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875643164789376:12345-192.168.203.5@tcp:8: 00010000:00080000:1.0:1788752835.692046:0:6690:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:1.0:1788752835.692075:0:6690:0:(genops.c:1384:class_connect()) connect: client 240b527c-392e-42d3-b78c-b594aea00353, cookie 0x80c8383f4848fd82 00002000:00100000:1.0:1788752835.692093:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 240b527c-392e-42d3-b78c-b594aea00353/ffff9c9a842b2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788752835.692118:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788752835.692440:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788752835.692486:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9c9a842b5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788752835.692576:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2357:x1875643164789376:12345-192.168.203.5@tcp:8: Request processed in 561us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752835.692584:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1788752835.692607:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164789632 00000100:00100000:3.0:1788752835.692615:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164789632 00000100:00100000:3.0:1788752835.693058:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:3.0:1788752835.693068:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164789632:12345-192.168.203.5@tcp:400: 00000100:00100000:3.0:1788752835.693890:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164789632:12345-192.168.203.5@tcp:400: Request processed in 818us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752835.693901:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 125 00000004:00080000:0.0:1788752835.714244:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 24734us 00000004:00200000:2.0:1788752835.739650:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788752835.739849:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+6:5584:x1875643164789504:12345-192.168.203.5@tcp:33: Request processed in 50485us (52416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752835.739863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1788752835.755686:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788752835.755727:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182635648:0@lo:13: 00000100:00100000:1.0:1788752835.755819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752835.755972:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635648 00000100:00100000:3.0:1788752835.755985:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635648 00000100:00100000:3.0:1788752835.756064:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788752835.756076:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182635648:12345-0@lo:13: 00002000:00000024:3.0:1788752835.756108:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752835.756190:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182635648:12345-0@lo:13: Request processed in 115us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752835.756197:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788752835.756218:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788752835.756305:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe551180 x1875643182635648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752835.756346:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182635648:0@lo:13: 00000100:00100000:0.0:1788752835.916712:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752835.916877:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164789760 00000100:00100000:3.0:1788752835.916891:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164789760 00000100:00100000:3.0:1788752835.916969:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788752835.916981:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:5623:x1875643164789760:12345-192.168.203.5@tcp:101: 00010000:00010000:3.0:1788752835.917007:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752835.919445:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848fd89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee79 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752835.919553:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848fd90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752835.919568:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848fd90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752835.919584:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848fd90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752835.919639:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788752835.919643:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752835.919662:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848fd90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752835.919692:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848fd89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee79 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752835.919711:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848fd90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee79 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752835.919720:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426100) 00010000:00010000:2.0:1788752835.919722:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752835.919726:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929600, rc 0) 00000100:00100000:2.0:1788752835.919801:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+7:5623:x1875643164789760:12345-192.168.203.5@tcp:101: Request processed in 2820us (3100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752835.919810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00010000:00010000:0.0:1788752836.522538:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752836.778594:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182635776:0@lo:13: 00000100:00100000:2.0:1788752836.778678:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752836.779336:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635776 00000100:00100000:3.0:1788752836.779345:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635776 00000100:00100000:3.0:1788752836.779411:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788752836.779421:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182635776:12345-0@lo:13: 00002000:00000024:3.0:1788752836.779443:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752836.779443:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182635904:0@lo:400: 00000100:00100000:2.0:1788752836.779513:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752836.779521:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182635776:12345-0@lo:13: Request processed in 101us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752836.779530:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788752836.779564:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182635904 00000100:00100000:3.0:1788752836.779568:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182635904 00000100:00100000:3.0:1788752836.779598:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788752836.779607:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3304:x1875643182635904:12345-0@lo:400: 00000100:00100000:2.0:1788752836.779627:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788752836.779636:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182636288:0@lo:400: 00000100:00100000:3.0:1788752836.779648:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3304:x1875643182635904:12345-0@lo:400: Request processed in 42us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752836.779669:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752836.779674:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788752836.779710:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182635904:0@lo:400: 00010000:00080000:3.0:1788752836.779744:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef51f80 x1875643182635776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752836.779744:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636288 00000100:00100000:3.0:1788752836.779755:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788752836.779762:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636288 00000100:00100000:3.0:1788752836.779777:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182635776:0@lo:13: 00000100:00100000:2.0:1788752836.779797:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788752836.779806:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182636288:12345-0@lo:400: 00000100:00100000:3.0:1788752836.779811:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182636032:0@lo:400: 00000100:00100000:3.0:1788752836.779852:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752836.779861:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182636288:12345-0@lo:400: Request processed in 55us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752836.779869:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788752836.779878:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788752836.779887:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182636160:0@lo:400: 00010000:00080000:2.0:1788752836.779910:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe07c000 x1875643182636288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752836.779915:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752836.779927:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182636288:0@lo:400: 00000100:00100000:3.0:1788752836.780187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636032 00000100:00100000:3.0:1788752836.780192:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636032 00000100:00100000:3.0:1788752836.780219:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636160 00000100:00100000:2.0:1788752836.780232:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182636416:0@lo:400: 00000100:00100000:3.0:1788752836.780301:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636160 00000100:00100000:3.0:1788752836.780332:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788752836.780341:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182636032:12345-0@lo:400: 00000100:00100000:2.0:1788752836.780362:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752836.780415:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe550380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182636032:12345-0@lo:400: Request processed in 74us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752836.780422:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788752836.780438:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636416 00000100:00100000:1.0:1788752836.780444:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636416 00000100:00100000:2.0:1788752836.780488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788752836.780497:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182636160:12345-0@lo:400: 00000100:00080000:0.0:1788752836.780517:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788752836.780523:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752836.780537:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe553b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182636160:12345-0@lo:400: Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752836.780544:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788752836.780813:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182636160:0@lo:400: 00000100:00100000:1.0:1788752836.780824:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788752836.780829:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182636032:0@lo:400: 00000100:00100000:1.0:1788752836.780841:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182636416:12345-0@lo:400: 00000100:00100000:1.0:1788752836.780885:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182636416:12345-0@lo:400: Request processed in 53us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752836.780891:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788752836.780902:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182636416:0@lo:400: 00010000:00010000:1.0:1788752837.548672:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752837.893105:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752837.893264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164789888 00000100:00100000:3.0:1788752837.893275:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164789888 00000100:00100000:3.0:1788752837.893347:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1788752837.893358:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+7:5675:x1875643164789888:12345-192.168.203.5@tcp:41: 00000004:00000024:3.0:1788752837.893403:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788752837.893485:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+7:5675:x1875643164789888:12345-192.168.203.5@tcp:41: Request processed in 127us (391us total) trans 0 rc 0/0 00000100:00080000:0.0:1788752837.893491:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752837.893493:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1788752837.897096:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752837.897263:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790016 00000100:00100000:3.0:1788752837.897273:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790016 00000100:00100000:3.0:1788752837.897342:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788752837.897351:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:240b527c-392e-42d3-b78c-b594aea00353+6:5675:x1875643164790016:12345-192.168.203.5@tcp:13: 00002000:00000024:3.0:1788752837.897388:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752837.897456:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:240b527c-392e-42d3-b78c-b594aea00353+6:5675:x1875643164790016:12345-192.168.203.5@tcp:13: Request processed in 107us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752837.897463:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00080000:0.0:1788752837.897700:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752837.902300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752837.902736:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790144 00000100:00100000:3.0:1788752837.902750:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790144 00000100:00100000:3.0:1788752837.902879:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1788752837.902892:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:240b527c-392e-42d3-b78c-b594aea00353+6:5675:x1875643164790144:12345-192.168.203.5@tcp:13: 00002000:00000024:3.0:1788752837.902949:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752837.903042:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:240b527c-392e-42d3-b78c-b594aea00353+6:5675:x1875643164790144:12345-192.168.203.5@tcp:13: Request processed in 151us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752837.903049:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00080000:0.0:1788752837.903149:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788752838.405003:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00010000:00010000:3.0:1788752838.571808:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752839.594400:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788752839.933036:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000001:00100000:1.0:1788752839.934649:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000001:02000400:2.0:1788752840.306690:0:8281:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788752840.618292:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752840.874595:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788752840.874627:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182636544:0@lo:13: 00000100:00100000:2.0:1788752840.874697:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752840.874918:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636544 00000100:00100000:3.0:1788752840.874934:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636544 00000100:00100000:3.0:1788752840.875042:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788752840.875056:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182636544:12345-0@lo:13: 00002000:00000024:3.0:1788752840.875107:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752840.875225:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182636544:12345-0@lo:13: Request processed in 172us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752840.875233:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788752840.875362:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe552a00 x1875643182636544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752840.875405:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe552a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182636544:0@lo:13: 00000100:00080000:0.0:1788752840.875518:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752841.009418:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752841.009473:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752841.009541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752841.010174:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790528 00000100:00100000:3.0:1788752841.010188:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790528 00000100:00100000:3.0:1788752841.010273:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1788752841.010285:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164790528:12345-192.168.203.5@tcp:400: 00000100:00100000:3.0:1788752841.010380:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164790528:12345-192.168.203.5@tcp:400: Request processed in 97us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752841.010388:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00080000:3.0:1788752841.010417:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752841.010524:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752841.010549:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790656 00000100:00100000:2.0:1788752841.010553:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790656 00000100:00100000:2.0:1788752841.010755:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1788752841.010763:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164790656:12345-192.168.203.5@tcp:400: 00000100:00100000:2.0:1788752841.010797:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164790656:12345-192.168.203.5@tcp:400: Request processed in 35us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752841.010803:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1788752841.010945:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790272 00000100:00100000:1.0:1788752841.010960:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790272 00000100:00100000:1.0:1788752841.010993:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:1.0:1788752841.011000:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164790272:12345-192.168.203.5@tcp:400: 00000100:00100000:1.0:1788752841.011028:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164790272:12345-192.168.203.5@tcp:400: Request processed in 28us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752841.011034:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:1.0:1788752841.011068:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790400 00000100:00100000:1.0:1788752841.011072:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790400 00000100:00100000:1.0:1788752841.011118:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:1.0:1788752841.011147:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164790400:12345-192.168.203.5@tcp:400: 00000100:00100000:1.0:1788752841.011194:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164790400:12345-192.168.203.5@tcp:400: Request processed in 49us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752841.011201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00080000:2.0:1788752841.014273:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788752841.014284:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788752841.644592:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752841.898584:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182636672:0@lo:400: 00000100:00100000:2.0:1788752841.898710:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752841.898850:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636672 00000100:00100000:0.0:1788752841.898863:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636672 00000100:00100000:0.0:1788752841.898929:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788752841.898939:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182636672:12345-0@lo:400: 00000100:00100000:3.0:1788752841.899141:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182637056:0@lo:400: 00000100:00100000:3.0:1788752841.899181:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752841.899227:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182637056 00000100:00100000:3.0:1788752841.899231:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182637056 00000100:00100000:3.0:1788752841.899271:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788752841.899277:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182637056:12345-0@lo:400: 00000100:00100000:3.0:1788752841.899321:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe550e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182637056:12345-0@lo:400: Request processed in 43us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752841.899328:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788752841.899370:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b1880 x1875643182637056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752857 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752841.899385:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182637056:0@lo:400: 00000100:00100000:0.0:1788752841.899781:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182636672:12345-0@lo:400: Request processed in 842us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752841.899789:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788752841.899879:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182636800:0@lo:400: 00000100:00100000:0.0:1788752841.899917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752841.899942:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788752841.899948:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182636928:0@lo:400: 00000100:00100000:0.0:1788752841.899969:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752841.900001:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636800 00000100:00100000:0.0:1788752841.900005:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636800 00000100:00100000:0.0:1788752841.900033:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182636928 00000100:00100000:0.0:1788752841.900035:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182636928 00000100:00100000:0.0:1788752841.900063:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788752841.900069:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182636800:12345-0@lo:400: 00000100:00100000:0.0:1788752841.900104:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182636800:12345-0@lo:400: Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752841.900118:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788752841.900149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788752841.900155:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182636928:12345-0@lo:400: 00000100:00100000:0.0:1788752841.900239:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182636928:12345-0@lo:400: Request processed in 83us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752841.900244:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788752841.900271:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752841.900302:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182636928:0@lo:400: 00000100:00100000:0.0:1788752841.900313:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182636800:0@lo:400: 00000100:00100000:3.0:1788752841.900375:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788752841.900385:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182637184:0@lo:13: 00000100:00100000:2.0:1788752841.900395:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182636672:0@lo:400: 00000100:00100000:3.0:1788752841.900424:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752841.900731:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182637184 00000100:00100000:0.0:1788752841.900737:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182637184 00000100:00100000:3.0:1788752841.900774:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182637312:0@lo:400: 00000100:00100000:3.0:1788752841.900805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752841.900817:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788752841.900825:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182637184:12345-0@lo:13: 00002000:00000024:0.0:1788752841.900862:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752841.900912:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe552d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182637184:12345-0@lo:13: Request processed in 88us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752841.900919:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788752841.900938:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182637312 00000100:00100000:0.0:1788752841.900941:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182637312 00010000:00080000:3.0:1788752841.900945:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef53480 x1875643182637184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752857 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752841.900962:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182637184:0@lo:13: 00000100:00080000:2.0:1788752841.901005:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788752841.901010:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752841.901100:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788752841.901108:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182637312:12345-0@lo:400: 00000100:00100000:0.0:1788752841.901289:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe552a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182637312:12345-0@lo:400: Request processed in 181us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752841.901296:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788752841.901318:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182637312:0@lo:400: 00010000:00010000:2.0:1788752842.666362:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788752843.377799:0:8428:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc9ccc810 20000000:00000080:3.0:1788752843.377819:0:8428:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c9bbe234c00 uarg=0000000000000000 20000000:01000000:3.0:1788752843.377854:0:8428:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788752843.377856:0:8428:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788752843.377859:0:8428:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788752843.377864:0:8428:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788752843.377869:0:8428:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788752843.377883:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788752843.377885:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788752843.378057:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788752843.378060:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788752843.379439:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788752843.379958:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788752843.380001:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788752843.380044:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788752843.380056:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788752843.380058:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788752843.381081:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788752843.381605:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788752843.381670:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788752843.381845:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788752843.381857:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788752843.381860:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788752843.382680:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788752843.385547:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788752843.385672:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788752843.385711:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788752843.385726:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788752843.385729:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788752843.386885:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788752843.387645:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788752843.387716:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788752843.387753:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788752843.387769:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788752843.387788:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387805:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387813:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387819:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387838:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fcef expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387844:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387850:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387857:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387868:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387876:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387884:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387921:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.387936:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 9 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.387949:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637440:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752843.388115:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.388271:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 9 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.388281:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637568:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752843.388324:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.388332:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.388340:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637696:0@lo:104: 00000100:00100000:3.0:1788752843.388388:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788752843.388466:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.388475:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.388483:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637824:0@lo:104: 00000100:00100000:3.0:1788752843.388511:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788752843.388863:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.388872:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 18 pid: 5825 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.388881:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637952:0@lo:104: 00010000:00010000:3.0:1788752843.388909:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fcef expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.388924:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fcef expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.388932:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638080:0@lo:104: 00010000:00010000:3.0:1788752843.388958:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.388966:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.388972:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638208:0@lo:104: 00010000:00010000:3.0:1788752843.388993:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.388999:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.389006:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638336:0@lo:104: 00010000:00010000:3.0:1788752843.389026:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.389032:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.389039:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638464:0@lo:104: 00000100:00100000:3.0:1788752843.389052:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928efe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752843.389356:0:7615:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788752843.389388:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.389422:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.389430:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.389438:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.389445:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.389452:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182637696 00000100:00100000:0.0:1788752843.389459:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182637696 00000100:00100000:0.0:1788752843.389495:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182637824 00000100:00100000:0.0:1788752843.389499:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182637824 00000100:00100000:0.0:1788752843.389510:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182637952 00000100:00100000:0.0:1788752843.389512:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182637952 00000100:00100000:0.0:1788752843.389520:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638080 00000100:00100000:0.0:1788752843.389523:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638080 00000100:00100000:0.0:1788752843.389531:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638208 00000100:00100000:0.0:1788752843.389533:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638208 00000100:00100000:0.0:1788752843.389541:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638336 00000100:00100000:0.0:1788752843.389543:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638336 00000100:00100000:0.0:1788752843.389553:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638464 00000100:00100000:0.0:1788752843.389555:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638464 00000100:00100000:0.0:1788752843.389568:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788752843.389576:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+9:8428:x1875643182637696:12345-0@lo:104: 00010000:00010000:0.0:1788752843.389589:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.389643:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788752843.389649:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+9:8428:x1875643182637696:12345-0@lo:104: Request processed in 74us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752843.389656:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788752843.389674:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788752843.389680:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85411850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+8:8428:x1875643182637824:12345-0@lo:104: 00010000:00010000:0.0:1788752843.389695:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.389730:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788752843.389734:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85411850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+8:8428:x1875643182637824:12345-0@lo:104: Request processed in 56us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752843.389740:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788752843.389773:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788752843.389779:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+7:8428:x1875643182637952:12345-0@lo:104: 00010000:00010000:0.0:1788752843.389787:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.389816:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788752843.389821:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+7:8428:x1875643182637952:12345-0@lo:104: Request processed in 43us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752843.389825:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788752843.389836:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788752843.389841:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+6:8428:x1875643182638080:12345-0@lo:104: 00010000:00010000:0.0:1788752843.389847:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.389870:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788752843.389873:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+6:8428:x1875643182638080:12345-0@lo:104: Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752843.389878:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788752843.389888:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788752843.389893:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+5:8428:x1875643182638208:12345-0@lo:104: 00010000:00010000:0.0:1788752843.389905:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.389932:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788752843.389937:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+5:8428:x1875643182638208:12345-0@lo:104: Request processed in 45us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752843.389943:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788752843.389955:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788752843.389960:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+4:8428:x1875643182638336:12345-0@lo:104: 00010000:00010000:0.0:1788752843.389968:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.389993:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788752843.389997:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+4:8428:x1875643182638336:12345-0@lo:104: Request processed in 38us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752843.390003:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788752843.390014:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788752843.390019:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:8428:x1875643182638464:12345-0@lo:104: 00010000:00010000:0.0:1788752843.390027:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390051:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1788752843.390055:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:8428:x1875643182638464:12345-0@lo:104: Request processed in 37us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752843.390061:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788752843.390433:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637696:0@lo:104: 00000100:00100000:3.0:1788752843.390444:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637824:0@lo:104: 00000100:00100000:3.0:1788752843.390461:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637952:0@lo:104: 00000100:00100000:3.0:1788752843.390468:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638080:0@lo:104: 00000100:00100000:3.0:1788752843.390473:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638208:0@lo:104: 00000100:00100000:3.0:1788752843.390479:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638336:0@lo:104: 00000100:00100000:3.0:1788752843.390485:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182638464:0@lo:104: 00000100:00100000:1.0:1788752843.390628:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1788752843.390683:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788752843.390690:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390703:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2c200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752843.390707:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390715:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752843.390723:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752843.390728:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752843.390798:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390805:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752843.390835:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390842:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fd43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd4a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390855:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788752843.390858:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390863:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752843.390867:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.390884:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752843.390890:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752843.390895:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788752843.390932:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788752843.390945:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182638592:0@lo:103: 00000100:00100000:2.0:1788752843.390987:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752843.391028:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638592 00000100:00100000:2.0:1788752843.391034:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638592 00010000:00010000:2.0:1788752843.391063:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 19 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752843.391084:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788752843.391090:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182638592:12345-0@lo:103: 00010000:00010000:2.0:1788752843.391100:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752843.391105:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 19 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.391113:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 19 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.391152:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848fd4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fd43 expref: 19 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.391164:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752843.391191:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3303:x1875643182638592:12345-0@lo:103: Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752843.391197:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788752843.391227:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182638592:0@lo:103: 00010000:00010000:0.0:1788752843.391494:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.391501:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788752843.391545:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788752843.391563:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.391571:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fd19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd20 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.391581:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788752843.391584:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.391589:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752843.391592:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.391598:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752843.391604:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752843.391615:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788752843.391691:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182638720:0@lo:103: 00000100:00100000:2.0:1788752843.391720:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752843.391805:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638720 00000100:00100000:1.0:1788752843.391810:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638720 00010000:00010000:1.0:1788752843.391830:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752843.391883:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788752843.391891:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3306:x1875643182638720:12345-0@lo:103: 00010000:00010000:1.0:1788752843.391900:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752843.391904:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752843.391912:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752843.391923:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fd20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fd19 expref: 18 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752843.391933:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752843.391975:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:3306:x1875643182638720:12345-0@lo:103: Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752843.391981:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788752843.392033:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182638720:0@lo:103: 00010000:00010000:0.0:1788752843.392090:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392097:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752843.392113:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392119:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9600/0x80c8383f4848fcfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fd04 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392153:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788752843.392156:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392161:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8800 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752843.392164:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392171:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752843.392177:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752843.392182:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752843.392196:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392201:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752843.392222:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392229:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fcef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcf6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392239:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788752843.392242:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392248:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8c00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752843.392251:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392258:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752843.392264:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752843.392269:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752843.392284:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392290:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752843.392295:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392301:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fce8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392309:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788752843.392317:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392323:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752843.392326:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392334:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752843.392340:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752843.392345:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752843.392359:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392365:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752843.392385:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392392:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173400/0x80c8383f4848fcb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcbe expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392401:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752843.392418:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392425:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752843.392428:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392445:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752843.392452:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752843.392457:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788752843.392473:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392479:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752843.392483:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392490:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fc8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fc94 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.392504:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752843.392506:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752843.392508:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752843.392518:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752843.392524:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752843.392534:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182639104:0@lo:103: 00000100:00100000:0.0:1788752843.392567:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.392888:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788752843.392895:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182638976:0@lo:103: 00000100:00100000:0.0:1788752843.392920:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752843.392937:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182639104 00000100:00100000:2.0:1788752843.392943:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182639104 00010000:00010000:2.0:1788752843.392965:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752843.392983:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788752843.392991:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:3304:x1875643182639104:12345-0@lo:103: 00010000:00010000:2.0:1788752843.393009:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752843.393014:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393023:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393034:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fce1 expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393043:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752843.393067:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3304:x1875643182639104:12345-0@lo:103: Request processed in 77us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752843.393072:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788752843.393479:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182639104:0@lo:103: 00000100:00100000:0.0:1788752843.393517:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182639232:0@lo:103: 00000100:00100000:0.0:1788752843.393544:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.393665:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788752843.393671:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182638848:0@lo:103: 00000100:00100000:0.0:1788752843.393692:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752843.393730:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638976 00000100:00100000:2.0:1788752843.393734:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638976 00010000:00010000:2.0:1788752843.393753:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fcef expref: 16 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752843.393778:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182639232 00000100:00100000:2.0:1788752843.393782:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182639232 00010000:00010000:2.0:1788752843.393793:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752843.393805:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788752843.393811:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:3304:x1875643182638976:12345-0@lo:103: 00010000:00010000:2.0:1788752843.393819:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752843.393824:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fcef expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393842:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fcef expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393854:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2d600/0x80c8383f4848fcf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fcef expref: 17 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393864:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752843.393892:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3304:x1875643182638976:12345-0@lo:103: Request processed in 81us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752843.393898:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788752843.393913:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788752843.393920:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+15:3305:x1875643182639232:12345-0@lo:103: 00010000:00010000:2.0:1788752843.393927:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752843.393930:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 15 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393938:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 15 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393948:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8200/0x80c8383f4848fcbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fcb7 expref: 15 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.393956:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752843.393976:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3305:x1875643182639232:12345-0@lo:103: Request processed in 57us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752843.393982:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788752843.394364:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182639360:0@lo:103: 00000100:00100000:2.0:1788752843.394462:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182638848 00000100:00100000:2.0:1788752843.394467:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182638848 00010000:00010000:2.0:1788752843.394492:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 14 pid: 5825 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752843.394513:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788752843.394519:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3305:x1875643182638848:12345-0@lo:103: 00010000:00010000:2.0:1788752843.394527:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752843.394530:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 14 pid: 5825 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.394538:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 14 pid: 5825 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.394548:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fd04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fcfd expref: 14 pid: 5825 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.394557:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752843.394595:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3305:x1875643182638848:12345-0@lo:103: Request processed in 76us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752843.394602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788752843.394718:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752843.394755:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182639232:0@lo:103: 00000100:00100000:0.0:1788752843.394772:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182638848:0@lo:103: 00000100:00100000:2.0:1788752843.394842:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182639360 00000100:00100000:2.0:1788752843.394847:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182639360 00010000:00010000:2.0:1788752843.394862:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 13 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752843.394876:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788752843.394882:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b98cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:3305:x1875643182639360:12345-0@lo:103: 00010000:00010000:2.0:1788752843.394888:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752843.394892:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 13 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.394911:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 13 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.394922:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fc94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fc8d expref: 13 pid: 5826 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.394931:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752843.394959:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b98cf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:3305:x1875643182639360:12345-0@lo:103: Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752843.394964:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788752843.395418:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637440:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752843.395429:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875643182637568:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752843.395470:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752843.395688:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182638976:0@lo:103: 00000100:00100000:0.0:1788752843.395831:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182639360:0@lo:103: 00000100:00100000:1.0:1788752843.400503:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752843.400543:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790784 00000100:00100000:2.0:1788752843.400553:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790784 00010000:00010000:2.0:1788752843.400589:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 10 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752843.400628:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:2.0:1788752843.400638:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2361:x1875643164790784:12345-192.168.203.5@tcp:103: 00010000:00010000:2.0:1788752843.400652:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752843.400658:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 10 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.400670:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 10 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.400690:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2c800/0x80c8383f4848fd58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee17 expref: 10 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.400704:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752843.400775:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:2361:x1875643164790784:12345-192.168.203.5@tcp:103: Request processed in 137us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752843.400782:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:0.0:1788752843.400870:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752843.400947:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164790912 00000100:00100000:3.0:1788752843.400954:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164790912 00010000:00010000:3.0:1788752843.400976:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 9 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752843.401008:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:3.0:1788752843.401016:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:2360:x1875643164790912:12345-192.168.203.5@tcp:103: 00010000:00010000:3.0:1788752843.401025:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752843.401031:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 9 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401053:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 9 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401067:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173000/0x80c8383f4848fd5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee1e expref: 9 pid: 5827 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401088:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401096:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401141:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401150:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401157:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401164:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401171:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2c000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788752843.401175:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401184:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401207:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752843.401218:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752843.401257:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:2360:x1875643164790912:12345-192.168.203.5@tcp:103: Request processed in 241us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752843.401270:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00010000:00010000:2.0:1788752843.401340:0:8428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.401347:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752843.401351:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fd97 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752843.690435:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752844.535305:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752844.536053:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791040 00000100:00100000:1.0:1788752844.536065:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791040 00000100:00100000:1.0:1788752844.536170:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:1.0:1788752844.536181:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:5598:x1875643164791040:12345-192.168.203.5@tcp:101: 00010000:00010000:1.0:1788752844.536197:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752844.536217:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe270000/0x80c8383f4848fd9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee80 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752844.536298:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe270000/0x80c8383f4848fd9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee80 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752844.536312:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe270000/0x80c8383f4848fd9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee80 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752844.536320:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270000, rc 0) 00000100:00100000:1.0:1788752844.536385:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5598:x1875643164791040:12345-192.168.203.5@tcp:101: Request processed in 205us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752844.536392:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:0.0:1788752844.545322:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752844.545431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791168 00000100:00100000:3.0:1788752844.545440:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791168 00000100:00100000:3.0:1788752844.545493:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:3.0:1788752844.545503:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5598:x1875643164791168:12345-192.168.203.5@tcp:501: 00000100:00100000:3.0:1788752844.546193:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5598:x1875643164791168:12345-192.168.203.5@tcp:501: Request processed in 687us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752844.546202:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:2.0:1788752844.552947:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752844.553244:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791296 00000100:00100000:3.0:1788752844.553255:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791296 00000100:00100000:3.0:1788752844.553367:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:3.0:1788752844.553379:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5598:x1875643164791296:12345-192.168.203.5@tcp:503: 00000100:00100000:3.0:1788752844.553634:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5598:x1875643164791296:12345-192.168.203.5@tcp:503: Request processed in 245us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752844.553641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:0.0:1788752844.561417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752844.565351:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791424 00000100:00100000:3.0:1788752844.565369:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791424 00000100:00100000:3.0:1788752844.565452:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:3.0:1788752844.565463:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:6068:x1875643164791424:12345-192.168.203.5@tcp:502: 00000100:00100000:3.0:1788752844.566061:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:6068:x1875643164791424:12345-192.168.203.5@tcp:502: Request processed in 596us (4663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752844.566569:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:0.0:1788752844.578990:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752844.582025:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791552 00000100:00100000:3.0:1788752844.582043:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791552 00000100:00100000:3.0:1788752844.582198:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:3.0:1788752844.582209:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:6068:x1875643164791552:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788752844.582508:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:6068:x1875643164791552:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 300us (3528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752844.582517:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:2.0:1788752844.589891:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752844.590245:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791680 00000100:00100000:3.0:1788752844.590256:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791680 00000100:00100000:3.0:1788752844.590316:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:3.0:1788752844.590327:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5598:x1875643164791680:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752844.590348:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752844.590371:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2c400/0x80c8383f4848fda5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee87 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752844.590416:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2c400/0x80c8383f4848fda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee87 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752844.590429:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2c400/0x80c8383f4848fda5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee87 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752844.590438:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2c400, rc 0) 00000100:00100000:3.0:1788752844.591770:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164791680:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 1435us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752844.591782:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:0.0:1788752844.600689:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752844.603188:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791808 00000100:00100000:3.0:1788752844.603206:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791808 00000100:00100000:3.0:1788752844.603341:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:3.0:1788752844.603352:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164791808:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752844.603661:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164791808:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 310us (2984us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788752844.603678:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 135 00010000:00010000:0.0:1788752844.715463:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788752845.162865:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788752845.162874:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9bafe44000 from 39 10000000:01000000:3.0:1788752845.162880:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788752845.162924:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.162935:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.162946:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752845.162968:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182639488:0@lo:101: 00000100:00100000:3.0:1788752845.163034:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.163105:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.166325:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182639488 00000100:00100000:0.0:1788752845.166340:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182639488 00000100:00100000:0.0:1788752845.166411:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788752845.166422:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+12:5829:x1875643182639488:12345-0@lo:101: 00010000:00010000:0.0:1788752845.166438:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752845.166454:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc9a00/0x80c8383f4848fdb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fdac expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.166506:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc9a00/0x80c8383f4848fdb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fdac expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.166517:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc9a00/0x80c8383f4848fdb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fdac expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.166527:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9a00, rc 0) 00000100:00100000:0.0:1788752845.166594:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182639488:12345-0@lo:101: Request processed in 174us (3560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.166600:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788752845.166890:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182639488:0@lo:101: 00010000:00010000:3.0:1788752845.166910:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.166920:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752845.166990:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182639616:0@lo:501: 00000100:00100000:3.0:1788752845.167031:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752845.167060:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182639616 00000100:00100000:1.0:1788752845.167066:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182639616 00000100:00100000:3.0:1788752845.167091:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef480 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.167109:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788752845.167117:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182639616:12345-0@lo:501: 00000100:00100000:1.0:1788752845.167384:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182639616:12345-0@lo:501: Request processed in 267us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.167390:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788752845.167630:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182639616:0@lo:501: 00000100:00100000:3.0:1788752845.167664:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182639744:0@lo:503: 00000100:00100000:3.0:1788752845.167696:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.167720:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef480 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.167818:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182639744 00000100:00100000:0.0:1788752845.167823:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182639744 00000100:00100000:0.0:1788752845.167850:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788752845.167856:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182639744:12345-0@lo:503: 00000100:00100000:0.0:1788752845.168025:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182639744:12345-0@lo:503: Request processed in 168us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.168031:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788752845.168264:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182639744:0@lo:503: 00000100:00100000:3.0:1788752845.168738:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8446:1875643182639872:0@lo:502: 00000100:00100000:3.0:1788752845.168783:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.168807:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.168944:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182639872 00000100:00100000:0.0:1788752845.168950:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182639872 00000100:00100000:0.0:1788752845.169012:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788752845.169019:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:8446:x1875643182639872:12345-0@lo:502: 00000100:00100000:0.0:1788752845.169630:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+13:8446:x1875643182639872:12345-0@lo:502: Request processed in 610us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.169637:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788752845.169716:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8446:1875643182639872:0@lo:502: 00000100:00100000:3.0:1788752845.169765:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8446:1875643182640000:0@lo:502: 00000100:00100000:3.0:1788752845.169793:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.174268:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.174399:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640000 00000100:00100000:2.0:1788752845.174409:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640000 00000100:00100000:2.0:1788752845.174455:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788752845.174463:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:8446:x1875643182640000:12345-0@lo:502: 00000100:00100000:2.0:1788752845.174720:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:8446:x1875643182640000:12345-0@lo:502: Request processed in 257us (4925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.174727:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788752845.174854:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8446:1875643182640000:0@lo:502: 00000040:00080000:3.0:1788752845.174898:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788752845.175239:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788752845.175256:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788752845.175266:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.175277:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752845.175288:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788752845.175290:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788752845.175293:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788752845.175319:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.175338:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.175348:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752845.175364:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640128:0@lo:101: 00000100:00100000:3.0:1788752845.175410:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.175421:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.175537:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640128 00000100:00100000:2.0:1788752845.175542:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640128 00000100:00100000:2.0:1788752845.175560:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788752845.175566:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+13:5829:x1875643182640128:12345-0@lo:101: 00010000:00010000:2.0:1788752845.175576:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752845.175587:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85928200/0x80c8383f4848fdc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fdba expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752845.175616:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85928200/0x80c8383f4848fdc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fdba expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752845.175626:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85928200/0x80c8383f4848fdc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fdba expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752845.175634:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928200, rc 0) 00000100:00100000:2.0:1788752845.175669:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182640128:12345-0@lo:101: Request processed in 103us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.175675:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788752845.176064:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640128:0@lo:101: 00010000:00010000:3.0:1788752845.176080:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.176089:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752845.176158:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640256:0@lo:501: 00000100:00100000:3.0:1788752845.176191:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.176207:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.176338:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640256 00000100:00100000:2.0:1788752845.176343:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640256 00000100:00100000:2.0:1788752845.176360:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788752845.176365:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182640256:12345-0@lo:501: 00000100:00100000:2.0:1788752845.176604:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182640256:12345-0@lo:501: Request processed in 238us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.176611:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788752845.177001:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640256:0@lo:501: 00000100:00100000:3.0:1788752845.177030:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640384:0@lo:503: 00000100:00100000:3.0:1788752845.177071:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.177101:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.177158:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640384 00000100:00100000:2.0:1788752845.177163:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640384 00000100:00100000:2.0:1788752845.177315:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788752845.177323:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182640384:12345-0@lo:503: 00000100:00100000:2.0:1788752845.177487:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182640384:12345-0@lo:503: Request processed in 165us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.177494:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788752845.177693:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640384:0@lo:503: 00000100:00100000:3.0:1788752845.178348:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8447:1875643182640512:0@lo:502: 00000100:00100000:3.0:1788752845.178409:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.178438:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.178485:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640512 00000100:00100000:2.0:1788752845.178491:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640512 00000100:00100000:2.0:1788752845.178532:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788752845.178546:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8447:x1875643182640512:12345-0@lo:502: 00000100:00100000:2.0:1788752845.178701:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8447:x1875643182640512:12345-0@lo:502: Request processed in 155us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.178708:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788752845.179029:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8447:1875643182640512:0@lo:502: 00000020:01000000:3.0:1788752845.179055:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752845.179065:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752845.179067:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788752845.179071:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788752845.179092:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8447:1875643182640640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752845.179276:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.179303:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.179370:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640640 00000100:00100000:2.0:1788752845.179375:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640640 00000100:00100000:2.0:1788752845.179412:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788752845.179420:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8447:x1875643182640640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752845.179627:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+14:8447:x1875643182640640:12345-0@lo:502:llog_process_th.0 Request processed in 207us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.179633:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788752845.179848:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8447:1875643182640640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788752845.180214:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752845.180227:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752845.180228:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788752845.180233:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788752845.180603:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788752845.180621:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788752845.180630:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.180641:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752845.180651:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788752845.180653:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9bbd907800 from 39 10000000:01000000:3.0:1788752845.180656:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788752845.180684:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.180692:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.180757:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752845.180789:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788752845.180832:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.181090:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640768 00000100:00100000:0.0:1788752845.181097:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640768 00000100:00100000:3.0:1788752845.181257:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef600 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.181323:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788752845.181332:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+14:5829:x1875643182640768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752845.181346:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752845.181358:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc9600/0x80c8383f4848fdcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fdc8 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.181380:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc9600/0x80c8383f4848fdcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fdc8 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.181399:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc9600/0x80c8383f4848fdcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fdc8 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.181409:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9600, rc 0) 00000100:00100000:0.0:1788752845.181484:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182640768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.181490:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788752845.181545:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752845.181559:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.181567:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752845.181614:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752845.181641:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.181672:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef600 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.181848:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182640896 00000100:00100000:1.0:1788752845.181854:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182640896 00000100:00100000:1.0:1788752845.182096:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788752845.182103:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182640896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752845.182723:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182640896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 618us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.182731:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788752845.182834:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182640896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752845.182863:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752845.182993:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.183070:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef600 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.183105:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641024 00000100:00100000:0.0:1788752845.183111:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641024 00000100:00100000:0.0:1788752845.183325:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788752845.183333:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182641024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.183488:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182641024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.183493:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788752845.183575:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788752845.189418:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8448:1875643182641152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.189508:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.189547:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641152 00000100:00100000:1.0:1788752845.189549:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91432d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788752845.189556:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641152 00000100:00100000:3.0:1788752845.189604:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788752845.189615:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8448:x1875643182641152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752845.189885:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8448:x1875643182641152:12345-0@lo:502:llog_process_th.0 Request processed in 271us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752845.189902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788752845.190030:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8448:1875643182641152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.190099:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8448:1875643182641280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.190363:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752845.190388:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91432d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.190412:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641280 00000100:00100000:0.0:1788752845.190423:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641280 00000100:00100000:0.0:1788752845.190458:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788752845.190466:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8448:x1875643182641280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752845.190721:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+15:8448:x1875643182641280:12345-0@lo:502:llog_process_th.0 Request processed in 256us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.190728:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788752845.191014:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8448:1875643182641280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788752845.191039:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788752845.191233:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788752845.191252:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788752845.191272:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.191285:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752845.191299:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788752845.191312:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788752845.191315:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788752845.191345:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.191354:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.191363:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752845.191378:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.191422:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.191452:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752845.191569:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641408 00000100:00100000:3.0:1788752845.191575:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641408 00000100:00100000:3.0:1788752845.191613:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788752845.191620:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:5829:x1875643182641408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752845.191631:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752845.191642:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fddd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fdd6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.191673:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fdd6 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.191685:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fdd6 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.191694:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2c000, rc 0) 00000100:00100000:3.0:1788752845.191743:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182641408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752845.191749:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788752845.191915:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752845.191929:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.191948:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752845.191996:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.192020:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.192042:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752845.192091:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641536 00000100:00100000:3.0:1788752845.192096:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641536 00000100:00100000:1.0:1788752845.192259:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788752845.192268:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182641536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752845.192779:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182641536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.192785:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788752845.192856:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.192889:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.192926:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.192956:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.193011:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641664 00000100:00100000:2.0:1788752845.193017:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641664 00000100:00100000:2.0:1788752845.193050:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788752845.193057:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182641664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.193234:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182641664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.193241:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788752845.193500:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182641664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752845.195635:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8449:1875643182641792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752845.195726:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.195761:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.195871:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641792 00000100:00100000:1.0:1788752845.195878:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641792 00000100:00100000:1.0:1788752845.195923:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788752845.195932:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8449:x1875643182641792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.196175:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8449:x1875643182641792:12345-0@lo:502:llog_process_th.0 Request processed in 243us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.196189:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788752845.196546:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8449:1875643182641792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788752845.196577:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752845.196585:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752845.196593:0:8449:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788752845.196600:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788752845.196622:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8449:1875643182641920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752845.196659:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.196692:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.196813:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182641920 00000100:00100000:0.0:1788752845.196819:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182641920 00000100:00100000:0.0:1788752845.196843:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788752845.196849:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8449:x1875643182641920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752845.197000:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:8449:x1875643182641920:12345-0@lo:502:llog_process_th.0 Request processed in 150us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.197008:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788752845.197259:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8449:1875643182641920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788752845.197280:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788752845.197285:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788752845.197286:0:8449:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788752845.197290:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788752845.197580:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788752845.197601:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788752845.197611:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.197628:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752845.197638:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788752845.197640:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9b90a5a800 from 39 10000000:01000000:0.0:1788752845.197643:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788752845.197770:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.197779:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.197788:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752845.198665:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.198728:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752845.198763:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b875a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.199466:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642048 00000100:00100000:1.0:1788752845.199475:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642048 00000100:00100000:1.0:1788752845.199534:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788752845.199542:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182642048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788752845.199557:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752845.199572:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe271a00/0x80c8383f4848fdeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fde4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752845.199597:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe271a00/0x80c8383f4848fdeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fde4 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752845.199609:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe271a00/0x80c8383f4848fdeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fde4 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752845.199618:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271a00, rc 0) 00000100:00100000:1.0:1788752845.199673:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182642048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.199680:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788752845.200259:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788752845.200281:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752845.200364:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752845.200449:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.200482:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752845.200554:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b875a7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.202149:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642176 00000100:00100000:0.0:1788752845.202250:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642176 00000100:00100000:0.0:1788752845.202379:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788752845.202390:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182642176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.202866:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182642176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 477us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.202874:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788752845.202951:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.202997:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.203109:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752845.203177:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642304 00000100:00100000:1.0:1788752845.203189:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642304 00000100:00100000:1.0:1788752845.203214:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788752845.203221:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182642304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.203368:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b875a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.203370:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182642304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.203379:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788752845.203385:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.203905:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8450:1875643182642432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752845.203942:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752845.203997:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba079ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.204035:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642432 00000100:00100000:0.0:1788752845.204041:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642432 00000100:00100000:0.0:1788752845.204098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788752845.204106:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8450:x1875643182642432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.204569:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8450:x1875643182642432:12345-0@lo:502:llog_process_th.0 Request processed in 461us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.204576:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788752845.204637:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8450:1875643182642432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752845.204683:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8450:1875643182642560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752845.204718:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752845.204749:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b875a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.205656:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642560 00000100:00100000:1.0:1788752845.205665:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642560 00000100:00100000:1.0:1788752845.205700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788752845.205708:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8450:x1875643182642560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.205937:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8450:x1875643182642560:12345-0@lo:502:llog_process_th.0 Request processed in 228us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.205945:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788752845.206046:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8450:1875643182642560:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788752845.206078:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788752845.208039:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788752845.208064:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788752845.208075:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.208088:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752845.208098:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788752845.208101:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788752845.208104:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788752845.208239:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.208248:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752845.208258:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752845.208283:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788752845.208473:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752845.208515:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928efd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.208652:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642688 00000100:00100000:2.0:1788752845.208661:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642688 00000100:00100000:2.0:1788752845.208710:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788752845.208719:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182642688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788752845.208732:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752845.208758:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fdf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fdf2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752845.208782:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fdf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fdf2 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752845.208793:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fdf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fdf2 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752845.208801:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929400, rc 0) 00000100:00100000:2.0:1788752845.208851:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182642688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.208859:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788752845.208934:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752845.208957:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.208966:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752845.209016:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.209042:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.209068:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752845.209116:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642816 00000100:00100000:3.0:1788752845.209145:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642816 00000100:00100000:3.0:1788752845.209388:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788752845.209404:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182642816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752845.209795:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182642816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752845.209802:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788752845.210049:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.210085:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.212982:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.214187:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.215564:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182642944 00000100:00100000:2.0:1788752845.215579:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182642944 00000100:00100000:2.0:1788752845.215645:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788752845.215656:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182642944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752845.215909:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182642944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.215916:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788752845.216173:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182642944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788752845.217023:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8451:1875643182643072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.217081:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752845.217178:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91432480 going to sleep for 11 seconds 00000100:00100000:2.0:1788752845.217285:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182643072 00000100:00100000:2.0:1788752845.217354:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182643072 00000100:00100000:2.0:1788752845.217432:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788752845.217441:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8451:x1875643182643072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752845.217673:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8451:x1875643182643072:12345-0@lo:502:llog_process_th.0 Request processed in 233us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.217681:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788752845.217756:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8451:1875643182643072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788752845.217783:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788752845.217791:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788752845.217793:0:8451:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788752845.217799:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788752845.217820:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8451:1875643182643200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752845.217854:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752845.218043:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91432480 going to sleep for 11 seconds 00000100:00100000:0.0:1788752845.218119:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182643200 00000100:00100000:0.0:1788752845.218146:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182643200 00000100:00100000:0.0:1788752845.218167:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788752845.218174:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8451:x1875643182643200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752845.218433:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8451:x1875643182643200:12345-0@lo:502:llog_process_th.0 Request processed in 258us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752845.218440:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788752845.218511:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8451:1875643182643200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788752845.218608:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788752845.218614:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788752845.218616:0:8451:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788752845.218619:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788752845.218921:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788752845.218941:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788752845.218952:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.218975:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752845.218984:0:5829:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788752845.218987:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c9b8731b380 from 1 10000000:01000000:0.0:1788752845.218990:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788752845.219013:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.219021:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.219029:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752845.219044:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182643328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.219074:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.219106:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.219242:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182643328 00000100:00100000:1.0:1788752845.219248:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182643328 00000100:00100000:1.0:1788752845.219270:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788752845.219277:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182643328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788752845.219288:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752845.219310:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe271400/0x80c8383f4848fe07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fe00 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752845.219330:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe271400/0x80c8383f4848fe07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fe00 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752845.219345:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe271400/0x80c8383f4848fe07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe00 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752845.219354:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271400, rc 0) 00000100:00100000:1.0:1788752845.219402:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182643328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752845.219409:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788752845.219530:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182643328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752845.219554:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.219562:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fe07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752845.219602:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182643456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752845.219624:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752845.219655:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788752845.219744:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182643456 00000100:00100000:1.0:1788752845.219748:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182643456 00000100:00100000:1.0:1788752845.219764:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788752845.219769:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182643456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752845.219958:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182643456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (332us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788752845.219973:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788752845.220073:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef50a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182643456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788752845.220093:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788752845.220098:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.220106:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752845.746572:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752845.994349:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788752845.994397:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182643584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752845.994483:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752845.994564:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182643584 00000100:00100000:2.0:1788752845.994574:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182643584 00000100:00100000:2.0:1788752845.994643:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788752845.994654:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182643584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788752845.994701:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752845.994752:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182643584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752845.994759:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788752845.994786:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788752845.994840:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a95f80 x1875643182643584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752845.994861:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182643584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752846.132470:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752846.132557:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752846.132592:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752846.132625:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752846.132657:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792320 00000100:00100000:0.0:1788752846.132669:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792320 00000100:00100000:0.0:1788752846.132734:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792192 00000100:00100000:0.0:1788752846.132737:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792192 00000100:00100000:0.0:1788752846.132759:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:0.0:1788752846.132770:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164792320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752846.132856:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164792320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752846.132865:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:0.0:1788752846.132885:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:0.0:1788752846.132892:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164792192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752846.132918:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164792192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752846.132937:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:2.0:1788752846.133277:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164791936 00000100:00100000:2.0:1788752846.133283:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164791936 00000100:00100000:2.0:1788752846.133326:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:2.0:1788752846.133334:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164791936:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752846.133371:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164791936:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752846.133377:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00080000:2.0:1788752846.133422:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788752846.133427:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788752846.133867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792064 00000100:00100000:1.0:1788752846.133874:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792064 00000100:00100000:1.0:1788752846.133934:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:1.0:1788752846.133942:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164792064:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752846.133989:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164792064:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752846.133997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00080000:3.0:1788752846.134382:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788752846.320221:0:8488:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd21317f10 20000000:00000080:2.0:1788752846.320240:0:8488:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c9b91462800 uarg=0000000000000000 20000000:01000000:2.0:1788752846.320275:0:8488:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788752846.320280:0:8488:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788752846.320291:0:8488:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788752846.324769:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788752846.324960:0:8488:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788752846.331575:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788752846.331638:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788752846.331693:0:8488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788752846.331712:0:8488:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788752846.331740:0:8488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.331760:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b80031a00/0x80c8383f4848fb83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.331768:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fbde expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.331775:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.331785:0:8488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.331795:0:8488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.331849:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.331869:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 9 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752846.331887:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182643712:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752846.332036:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.332057:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 18 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752846.332068:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182643840:0@lo:104: 00000100:00100000:2.0:1788752846.332147:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788752846.332190:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fbde expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.332198:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fbde expref: 18 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752846.332206:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182643968:0@lo:104: 00000100:00100000:2.0:1788752846.332238:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788752846.332269:0:8488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b80031a00/0x80c8383f4848fb83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752846.332277:0:8488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b80031a00/0x80c8383f4848fb83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 18 pid: 5826 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752846.332285:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182644096:0@lo:104: 00000100:00100000:2.0:1788752846.332305:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788752846.332405:0:7615:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788752846.332428:0:7615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752846.332451:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182643968 00000100:00100000:1.0:1788752846.332451:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182643840 00000100:00100000:1.0:1788752846.332459:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182643840 00000100:00100000:3.0:1788752846.332468:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182643968 00000100:00100000:3.0:1788752846.332508:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644096 00000100:00100000:3.0:1788752846.332511:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644096 00000100:00100000:0.0:1788752846.332554:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788752846.332571:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8506c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+5:8488:x1875643182643968:12345-0@lo:104: 00010000:00010000:0.0:1788752846.332587:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.332658:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788752846.332665:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8506c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+5:8488:x1875643182643968:12345-0@lo:104: Request processed in 101us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752846.332672:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788752846.332693:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182643968:0@lo:104: 00000100:00100000:1.0:1788752846.335788:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788752846.335813:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788752846.335821:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+4:8488:x1875643182643840:12345-0@lo:104: 00010000:00010000:0.0:1788752846.335828:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752846.335838:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788752846.335847:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.335847:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752846.335855:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752846.335860:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:8488:x1875643182644096:12345-0@lo:104: 00010000:00010000:0.0:1788752846.335891:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.335896:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752846.335899:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752846.335914:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788752846.335960:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.335999:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788752846.336014:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788752846.336023:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1788752846.336030:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752846.336035:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+4:8488:x1875643182644096:12345-0@lo:104: Request processed in 181us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752846.336043:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+4:8488:x1875643182643840:12345-0@lo:104: Request processed in 233us (3916us total) trans 0 rc 0/0 00010000:00010000:0.0:1788752846.336061:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8a00/0x80c8383f4848fbde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fbe5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.336077:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788752846.336080:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.336085:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173a00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752846.336087:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.336094:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752846.336099:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752846.336104:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788752846.336356:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788752846.336381:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788752846.336397:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336404:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788752846.336407:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336414:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788752846.336433:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752846.336438:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788752846.336455:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336461:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788752846.336479:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336486:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d200/0x80c8383f4848fb7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fb83 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336496:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752846.336498:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752846.336499:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752846.336513:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182644352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788752846.336550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752846.336601:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644352 00000100:00100000:3.0:1788752846.336609:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644352 00010000:00010000:3.0:1788752846.336634:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b80031a00/0x80c8383f4848fb83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 19 pid: 5826 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.336637:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.336652:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788752846.336667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788752846.336675:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182644352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788752846.336675:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.336686:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bc2173a00/0x80c8383f4848fca9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fcb0 expref: -99 pid: 7609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.336707:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752846.336709:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752846.336711:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752846.336728:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752846.336739:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182644224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788752846.336768:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752846.336775:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b80031a00/0x80c8383f4848fb83 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 19 pid: 5826 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336792:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b80031a00/0x80c8383f4848fb83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 19 pid: 5826 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336808:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752846.336833:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182644352:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752846.336840:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788752846.336861:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182644480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788752846.336884:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752846.336911:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644480 00000100:00100000:3.0:1788752846.336915:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644480 00010000:00010000:3.0:1788752846.336928:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 19 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752846.336946:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788752846.336952:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182644480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788752846.336966:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752846.336970:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 19 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336978:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 19 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.336987:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752846.337008:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752846.337018:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182644480:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752846.337026:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788752846.337040:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644224 00000100:00100000:3.0:1788752846.337049:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644224 00010000:00010000:3.0:1788752846.337922:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fbde expref: 19 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752846.337945:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788752846.337955:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3304:x1875643182644224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788752846.337965:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752846.337969:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fbde expref: 19 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.337978:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fbde expref: 19 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.337989:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928a00/0x80c8383f4848fbe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fbde expref: 19 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.337999:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752846.338050:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3304:x1875643182644224:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752846.338056:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788752846.338451:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182644224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788752846.338559:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182644480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788752846.338578:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182644352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788752846.338947:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752846.338989:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182643712:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752846.339002:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2cc00/0x80c8383f4848fcb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fca9 expref: 17 pid: 5825 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752846.339014:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182643840:0@lo:104: 00010000:00010000:2.0:1788752846.339051:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b80031a00/0x80c8383f4848fb83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fb7c expref: 16 pid: 5826 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752846.339065:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8488:1875643182644096:0@lo:104: 00010000:00010000:2.0:1788752846.339093:0:8488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752846.339445:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792448 00000100:00100000:3.0:1788752846.339453:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792448 00010000:00010000:3.0:1788752846.339477:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 10 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752846.339511:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:3.0:1788752846.339520:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2361:x1875643164792448:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752846.339537:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752846.339542:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 10 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339552:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 10 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339566:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85929a00/0x80c8383f4848fd6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee4f expref: 10 pid: 5827 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339580:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339588:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339601:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339608:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339614:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339621:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339627:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85929c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788752846.339630:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339648:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339672:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.339683:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752846.339711:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788752846.339751:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:2361:x1875643164792448:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 218us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752846.339761:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00010000:00010000:0.0:1788752846.339915:0:8488:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.339924:0:8488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752846.339930:0:8488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752846.389280:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752846.389534:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792576 00000100:00100000:3.0:1788752846.389547:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792576 00000100:00100000:3.0:1788752846.389620:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:3.0:1788752846.389633:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:5598:x1875643164792576:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752846.389659:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752846.389686:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee8e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.389723:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.389735:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752846.389746:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ce00, rc 0) 00000100:00100000:3.0:1788752846.389830:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164792576:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 199us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752846.389838:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:3.0:1788752846.393256:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752846.395896:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792704 00000100:00100000:0.0:1788752846.395915:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792704 00000100:00100000:0.0:1788752846.396831:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:0.0:1788752846.396858:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164792704:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752846.397610:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164792704:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 760us (4362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752846.398884:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:0.0:1788752846.403693:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752846.403785:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792832 00000100:00100000:3.0:1788752846.403801:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792832 00000100:00100000:3.0:1788752846.403873:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:3.0:1788752846.403887:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164792832:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752846.404375:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:5598:x1875643164792832:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 490us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752846.404395:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:3.0:1788752846.407624:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752846.407744:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164792960 00000100:00100000:0.0:1788752846.407771:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164792960 00000100:00100000:0.0:1788752846.407841:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:0.0:1788752846.407855:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:6095:x1875643164792960:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788752846.408455:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:6095:x1875643164792960:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 601us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752846.408465:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:3.0:1788752846.412698:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752846.412783:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793088 00000100:00100000:1.0:1788752846.412797:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793088 00000100:00100000:1.0:1788752846.412863:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:1.0:1788752846.412873:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:6095:x1875643164793088:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788752846.413116:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:6095:x1875643164793088:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 244us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752846.413151:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 173 00010000:00010000:0.0:1788752846.765892:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752847.021603:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182644608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752847.021705:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.022001:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644608 00000100:00100000:0.0:1788752847.022012:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644608 00000100:00100000:0.0:1788752847.022082:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788752847.022093:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182644608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752847.022153:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752847.022207:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182644608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.022215:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788752847.022240:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788752847.022279:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef51500 x1875643182644608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752847.022301:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182644608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752847.022740:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182644864:0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.022778:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.022805:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788752847.022811:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182644992:0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.022860:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.022894:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644864 00000100:00100000:0.0:1788752847.022900:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644864 00000100:00100000:0.0:1788752847.022935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788752847.022942:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182644864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.022983:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182644864:12345-0@lo:400:kworker.0 Request processed in 41us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.022989:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788752847.023008:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644992 00000100:00100000:0.0:1788752847.023012:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644992 00000100:00100000:0.0:1788752847.023043:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788752847.023050:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182644992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.023080:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182644992:12345-0@lo:400:kworker.0 Request processed in 31us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.023087:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788752847.023111:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182644736:0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.023153:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.023171:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788752847.023176:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182645120:0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.023198:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.023218:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182644736 00000100:00100000:0.0:1788752847.023222:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182644736 00000100:00100000:0.0:1788752847.023238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182645120 00000100:00100000:0.0:1788752847.023241:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182645120 00000100:00100000:0.0:1788752847.023256:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788752847.023261:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182644736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.023293:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182644736:12345-0@lo:400:kworker.0 Request processed in 31us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.023306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788752847.023319:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788752847.023324:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182645120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.023352:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182645120:12345-0@lo:400:kworker.0 Request processed in 29us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.023358:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788752847.023378:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788752847.023391:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752847.023415:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182645120:0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.023426:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182644736:0@lo:400:kworker.0 00010000:00080000:0.0:1788752847.023458:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef53b80 x1875643182644992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752847.023468:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182644992:0@lo:400:kworker.0 00000100:00100000:0.0:1788752847.023478:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182644864:0@lo:400:kworker.0 10000000:01000000:0.0:1788752847.147187:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788752847.147198:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bafe44000 from 4 10000000:01000000:0.0:1788752847.147204:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788752847.147267:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752847.147281:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752847.147295:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752847.147354:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788752847.147465:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752847.147547:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182645248 00000100:00100000:0.0:1788752847.147554:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752847.147559:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182645248 00000100:00100000:3.0:1788752847.147637:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788752847.147650:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182645248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752847.147667:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752847.147685:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fe1c expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.147730:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.147744:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.147765:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ca00, rc 0) 00000100:00100000:3.0:1788752847.147821:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182645248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752847.147830:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788752847.148019:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752847.148039:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752847.148050:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752847.148149:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752847.148185:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.148211:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752847.149169:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182645376 00000100:00100000:3.0:1788752847.149180:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182645376 00000100:00100000:3.0:1788752847.149229:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788752847.149240:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182645376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752847.149623:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182645376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752847.149632:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788752847.150377:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.150461:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.150525:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752847.150573:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752847.150649:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182645504 00000100:00100000:0.0:1788752847.150656:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182645504 00000100:00100000:0.0:1788752847.150707:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788752847.150718:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182645504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752847.150946:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182645504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.150956:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788752847.151119:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.155334:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8526:1875643182645632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752847.155662:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752847.156645:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788752847.159169:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182645632 00000100:00100000:3.0:1788752847.159188:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182645632 00000100:00100000:3.0:1788752847.159254:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788752847.159264:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8526:x1875643182645632:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752847.159607:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8526:x1875643182645632:12345-0@lo:502:llog_process_th.0 Request processed in 343us (3944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752847.159615:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788752847.159750:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8526:1875643182645632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788752847.160074:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788752847.160087:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752847.160090:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788752847.160099:0:8526:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bafe44000 00000020:00000080:2.0:1788752847.160102:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788752847.160330:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8526:1875643182645760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752847.160408:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752847.160451:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182645760 00000100:00100000:2.0:1788752847.160457:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182645760 00000100:00100000:2.0:1788752847.160875:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788752847.160889:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8526:x1875643182645760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752847.161118:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:8526:x1875643182645760:12345-0@lo:502:llog_process_th.0 Request processed in 232us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752847.161159:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788752847.161224:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752847.161248:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8526:1875643182645760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788752847.161278:0:8526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788752847.161285:0:8526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788752847.161287:0:8526:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788752847.161291:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788752847.161367:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788752847.161403:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788752847.161417:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752847.161431:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752847.161443:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788752847.161447:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbd907800 from 4 10000000:01000000:2.0:1788752847.161450:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788752847.161482:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752847.161492:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752847.161571:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752847.161592:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.161636:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752847.161658:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752847.162035:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182645888 00000100:00100000:2.0:1788752847.162043:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182645888 00000100:00100000:2.0:1788752847.162072:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788752847.162079:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182645888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788752847.162093:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752847.162108:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fe2a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752847.162155:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752847.162167:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752847.162177:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928600, rc 0) 00000100:00100000:2.0:1788752847.162218:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182645888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752847.162225:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788752847.162266:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182645888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788752847.162282:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752847.162292:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752847.162349:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.162403:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752847.162425:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752847.162436:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646016 00000100:00100000:2.0:1788752847.162439:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646016 00000100:00100000:2.0:1788752847.162457:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788752847.162462:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182646016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.163068:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182646016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 604us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752847.163077:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788752847.163119:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.163183:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.163232:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752847.163252:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752847.163282:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646144 00000100:00100000:2.0:1788752847.163287:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646144 00000100:00100000:2.0:1788752847.163309:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788752847.163316:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182646144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752847.163635:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182646144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752847.163643:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788752847.163720:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752847.163913:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8528:1875643182646272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752847.163958:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.163980:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646272 00000100:00100000:0.0:1788752847.163989:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646272 00000100:00100000:0.0:1788752847.166781:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788752847.166805:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8528:x1875643182646272:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752847.167261:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752847.167949:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8528:x1875643182646272:12345-0@lo:502:llog_process_th.0 Request processed in 1150us (3986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.167961:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788752847.168292:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8528:1875643182646272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788752847.168424:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788752847.168438:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788752847.168441:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788752847.168457:0:8528:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bbd907800 00000020:00000080:1.0:1788752847.168460:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788752847.168566:0:8528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8528:1875643182646400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752847.168630:0:8528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.168738:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646400 00000100:00100000:0.0:1788752847.168746:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646400 00000100:00100000:0.0:1788752847.168796:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788752847.168804:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8528:x1875643182646400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752847.169042:0:8528:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752847.172394:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:8528:x1875643182646400:12345-0@lo:502:llog_process_th.0 Request processed in 3493us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752847.172413:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788752847.172547:0:8528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8528:1875643182646400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788752847.172597:0:8528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752847.172607:0:8528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752847.172609:0:8528:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788752847.172620:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788752847.173632:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788752847.173663:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788752847.173677:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752847.173692:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752847.173705:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788752847.173708:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9b90a5a800 from 4 10000000:01000000:0.0:1788752847.173716:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788752847.173763:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752847.173772:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752847.173785:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752847.173811:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788752847.173876:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752847.173990:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baedf8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788752847.174589:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646528 00000100:00100000:3.0:1788752847.174601:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646528 00000100:00100000:3.0:1788752847.174665:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788752847.174676:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182646528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752847.174694:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752847.174710:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fe38 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.174739:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.174750:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.174766:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d200, rc 0) 00000100:00100000:3.0:1788752847.174828:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182646528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752847.174834:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788752847.174906:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752847.174925:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.174934:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752847.175408:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752847.175452:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752847.175531:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef540 going to sleep for 11 seconds 00000100:00100000:1.0:1788752847.175627:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646656 00000100:00100000:1.0:1788752847.175634:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646656 00000100:00100000:1.0:1788752847.175703:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788752847.175712:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182646656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752847.176193:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182646656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 480us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752847.176201:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788752847.176327:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752847.176374:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752847.176430:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752847.176458:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef540 going to sleep for 11 seconds 00000100:00100000:3.0:1788752847.176485:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646784 00000100:00100000:3.0:1788752847.176491:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646784 00000100:00100000:3.0:1788752847.176519:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788752847.176526:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182646784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752847.176710:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182646784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752847.176726:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788752847.176766:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182646784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752847.177336:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8532:1875643182646912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752847.177396:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752847.177431:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182646912 00000100:00100000:3.0:1788752847.177436:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182646912 00000100:00100000:3.0:1788752847.177464:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788752847.178018:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:8532:x1875643182646912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752847.178465:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:8532:x1875643182646912:12345-0@lo:502:llog_process_th.0 Request processed in 452us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752847.178555:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788752847.178631:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928ef540 going to sleep for 11 seconds 00000100:00100000:3.0:1788752847.178657:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8532:1875643182646912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788752847.178694:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752847.178706:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752847.178709:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788752847.178718:0:8532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9b90a5a800 00000020:00000080:3.0:1788752847.178720:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788752847.180806:0:8532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8532:1875643182647040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752847.180899:0:8532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752847.181003:0:8532:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb2569480 going to sleep for 11 seconds 00000100:00100000:1.0:1788752847.181195:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647040 00000100:00100000:1.0:1788752847.181205:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647040 00000100:00100000:1.0:1788752847.181294:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788752847.181304:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:8532:x1875643182647040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752847.181715:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:8532:x1875643182647040:12345-0@lo:502:llog_process_th.0 Request processed in 411us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752847.181723:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788752847.181871:0:8532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:8532:1875643182647040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788752847.181904:0:8532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752847.181912:0:8532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752847.181914:0:8532:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788752847.181925:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788752847.181992:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788752847.182011:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788752847.182024:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.182037:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752847.786687:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752848.811519:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752849.835382:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752850.858266:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752851.115103:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788752851.115142:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182647168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752851.115207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752851.115271:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647168 00000100:00100000:2.0:1788752851.115279:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647168 00000100:00100000:2.0:1788752851.115337:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788752851.115365:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182647168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788752851.115400:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752851.115442:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182647168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752851.115449:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788752851.115472:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788752851.115498:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a95f80 x1875643182647168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752867 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752851.115517:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182647168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752851.249313:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752851.249371:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752851.249401:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793216 00000100:00100000:2.0:1788752851.249409:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793216 00000100:00100000:2.0:1788752851.249451:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:2.0:1788752851.249460:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164793216:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752851.249523:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164793216:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752851.249530:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:2.0:1788752851.249561:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793472 00000100:00100000:2.0:1788752851.249564:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793472 00000100:00100000:2.0:1788752851.249594:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1788752851.249599:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164793472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752851.249621:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164793472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752851.249627:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00080000:2.0:1788752851.249712:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752851.256442:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752851.256485:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752851.256529:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793600 00000100:00100000:0.0:1788752851.256538:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793600 00000100:00100000:0.0:1788752851.256594:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:0.0:1788752851.256603:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164793600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752851.256670:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164793600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752851.256677:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00080000:0.0:1788752851.256698:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752851.256838:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793344 00000100:00100000:2.0:1788752851.256843:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793344 00000100:00100000:2.0:1788752851.256888:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:2.0:1788752851.256896:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164793344:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752851.256933:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164793344:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 37us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752851.256939:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00080000:0.0:1788752851.257018:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788752851.882886:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788752851.978922:0:8789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1788752852.139756:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182647296:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.139832:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752852.139878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182647808:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.139905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752852.139942:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788752852.139949:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182647424:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.139970:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752852.139994:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182647936:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140021:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752852.140051:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182647552:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752852.140090:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752852.140095:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182647680:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140113:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752852.140160:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647296 00000100:00100000:1.0:1788752852.140167:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647296 00000100:00100000:1.0:1788752852.140207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788752852.140216:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182647296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140262:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182647296:12345-0@lo:400:kworker.0 Request processed in 47us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752852.140270:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788752852.140296:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647808 00000100:00100000:1.0:1788752852.140300:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647808 00000100:00100000:1.0:1788752852.140327:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647424 00000100:00100000:1.0:1788752852.140329:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647424 00000100:00100000:1.0:1788752852.140340:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647552 00000100:00100000:1.0:1788752852.140342:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647552 00000100:00100000:1.0:1788752852.140369:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788752852.140382:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182647808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140411:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182647808:12345-0@lo:400:kworker.0 Request processed in 31us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752852.140417:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788752852.140429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788752852.140434:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182647424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140456:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182647424:12345-0@lo:400:kworker.0 Request processed in 22us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752852.140462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788752852.140472:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788752852.140477:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182647552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140501:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182647552:12345-0@lo:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752852.140506:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788752852.140526:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647936 00000100:00100000:1.0:1788752852.140529:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647936 00000100:00100000:1.0:1788752852.140551:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182647680 00000100:00100000:1.0:1788752852.140553:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182647680 00000100:00100000:1.0:1788752852.140564:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788752852.140570:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182647936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140610:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182647936:12345-0@lo:400:kworker.0 Request processed in 40us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752852.140615:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788752852.140626:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788752852.140632:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182647680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140655:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182647680:12345-0@lo:400:kworker.0 Request processed in 23us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752852.140665:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788752852.140689:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788752852.140693:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788752852.140722:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b1f80 x1875643182647680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752852.140735:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182647680:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140745:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182647552:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140773:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182647424:0@lo:400:kworker.0 00010000:00080000:1.0:1788752852.140782:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b1180 x1875643182647936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752852.140790:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182647936:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140798:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182647296:0@lo:400:kworker.0 00000100:00100000:1.0:1788752852.140806:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182647808:0@lo:400:kworker.0 00000100:00100000:0.0:1788752852.142234:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788752852.142249:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182648064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752852.142299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752852.142358:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648064 00000100:00100000:0.0:1788752852.142364:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648064 00000100:00100000:0.0:1788752852.142398:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788752852.142406:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182648064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752852.142437:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752852.142475:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182648064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752852.142481:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788752852.142517:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef53b80 x1875643182648064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752852.142533:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182648064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788752852.906338:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752853.931372:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752854.957867:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752855.979645:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752856.236180:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752856.236203:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182648192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752856.236269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752856.236330:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648192 00000100:00100000:0.0:1788752856.236339:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648192 00000100:00080000:1.0:1788752856.236386:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752856.236399:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788752856.236410:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182648192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788752856.236443:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752856.236497:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182648192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752856.236504:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788752856.236534:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b3480 x1875643182648192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752856.236555:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182648192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752856.369274:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752856.369341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752856.369375:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752856.369398:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752856.370300:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793728 00000100:00100000:1.0:1788752856.370311:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793728 00000100:00100000:1.0:1788752856.370413:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 191 00000100:00100000:1.0:1788752856.370425:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164793728:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752856.370670:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164793728:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 246us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752856.370678:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 191 00000100:00100000:1.0:1788752856.370715:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793984 00000100:00100000:1.0:1788752856.370719:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793984 00000100:00100000:1.0:1788752856.370755:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164794112 00000100:00100000:1.0:1788752856.370758:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164794112 00000100:00100000:1.0:1788752856.371036:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:1.0:1788752856.371045:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164793984:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752856.371092:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164793984:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752856.371098:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:1.0:1788752856.371113:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:1.0:1788752856.371142:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164794112:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752856.371170:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164794112:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 50us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752856.371176:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:1.0:1788752856.371195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164793856 00000100:00100000:1.0:1788752856.371200:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164793856 00000100:00100000:1.0:1788752856.371232:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:1.0:1788752856.371240:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164793856:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752856.371284:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164793856:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752856.371300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00080000:1.0:1788752856.371331:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788752856.371336:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788752856.371338:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788752857.003280:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752857.258275:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182648448:0@lo:400:kworker.0 00000100:00100000:1.0:1788752857.258280:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182648320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752857.263653:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752857.263824:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648320 00000100:00100000:2.0:1788752857.263835:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648320 00000100:00100000:2.0:1788752857.263899:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788752857.263910:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182648320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788752857.263949:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752857.263996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752857.264007:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182648320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752857.264013:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788752857.264032:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182648960:0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.264073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752857.264118:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182648704:0@lo:400:kworker.0 00000100:00100000:2.0:1788752857.264158:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648960 00000100:00100000:0.0:1788752857.264161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752857.264163:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648960 00000100:00100000:0.0:1788752857.264180:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788752857.264186:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182648576:0@lo:400:kworker.0 00000100:00100000:2.0:1788752857.264189:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648704 00000100:00100000:2.0:1788752857.264191:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648704 00000100:00100000:0.0:1788752857.264210:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752857.264211:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788752857.264217:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182648960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.264221:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182649088:0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.264242:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752857.264252:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182648960:12345-0@lo:400:kworker.0 Request processed in 36us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752857.264258:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788752857.264279:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648576 00000100:00100000:2.0:1788752857.264282:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648576 00000100:00100000:2.0:1788752857.264295:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788752857.264300:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182648704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.264347:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648448 00000100:00100000:2.0:1788752857.264350:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182648704:12345-0@lo:400:kworker.0 Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752857.264351:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648448 00000100:00100000:2.0:1788752857.264357:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788752857.264373:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788752857.264382:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182648576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.264384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788752857.264390:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182648448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.264421:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182648448:12345-0@lo:400:kworker.0 Request processed in 32us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752857.264428:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788752857.264488:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182648576:12345-0@lo:400:kworker.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752857.264496:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788752857.265673:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182648960:0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.265689:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182648448:0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.265720:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649088 00000100:00100000:0.0:1788752857.265725:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649088 00000100:00100000:0.0:1788752857.265768:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788752857.265776:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182649088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.265832:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182649088:12345-0@lo:400:kworker.0 Request processed in 56us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752857.265844:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788752857.265874:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182648576:0@lo:400:kworker.0 00000100:00100000:1.0:1788752857.265929:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182648832:0@lo:400:kworker.0 00000100:00100000:1.0:1788752857.265973:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788752857.266015:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bae9d3b80 x1875643182648320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752857.266033:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182648320:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788752857.266049:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a95500 x1875643182649088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752857.266061:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182649088:0@lo:400:kworker.0 00000100:00100000:0.0:1788752857.266077:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182648704:0@lo:400:kworker.0 00000100:00100000:2.0:1788752857.266358:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182648832 00000100:00100000:2.0:1788752857.266365:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182648832 00000100:00100000:2.0:1788752857.266400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788752857.266407:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182648832:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788752857.268154:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788752857.268165:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752857.268183:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182648832:12345-0@lo:400:kworker.0 Request processed in 1771us (2204us total) trans 0 rc 0/0 00010000:00080000:0.0:1788752857.268183:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a95880 x1875643182648832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752857.268195:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788752857.268198:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182648832:0@lo:400:kworker.0 00000001:02000400:3.0:1788752857.268573:0:9033:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing yml_node 00010000:00010000:2.0:1788752858.026688:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752859.052902:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752860.074416:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752861.098460:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752861.360502:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788752861.360523:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182649216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752861.360587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752861.360660:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649216 00000100:00100000:3.0:1788752861.360673:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649216 00000100:00080000:1.0:1788752861.360707:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752861.360736:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788752861.360744:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788752861.360751:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182649216:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752861.360756:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788752861.361400:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752861.361464:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182649216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 718us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752861.361472:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788752861.362041:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b1c00 x1875643182649216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752861.362063:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182649216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752861.506070:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752861.506145:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752861.506187:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752861.506205:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164794368 00000100:00100000:0.0:1788752861.506219:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752861.506224:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164794368 00000100:00100000:0.0:1788752861.506254:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164794240 00000100:00100000:0.0:1788752861.506265:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164794240 00000100:00100000:0.0:1788752861.506334:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00100000:3.0:1788752861.506345:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:0.0:1788752861.506348:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2358:x1875643164794240:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752861.506365:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164794368:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752861.506425:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2358:x1875643164794240:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752861.506434:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00100000:3.0:1788752861.506446:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164794368:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 87us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752861.506457:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:0.0:1788752861.506476:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164794496 00000100:00100000:0.0:1788752861.506482:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164794496 00000100:00080000:3.0:1788752861.506506:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788752861.506514:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752861.506546:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164794624 00000100:00100000:0.0:1788752861.506551:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164794624 00000100:00100000:0.0:1788752861.506583:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:0.0:1788752861.506591:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2357:x1875643164794496:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:0.0:1788752861.506619:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fd7b 00000100:00080000:0.0:1788752861.506629:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5102800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1788752861.506641:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1788752861.506666:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788752861.507054:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+2:2357:x1875643164794496:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 463us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752861.507062:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:0.0:1788752861.507077:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:0.0:1788752861.507083:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2357:x1875643164794624:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:0.0:1788752861.507098:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fd82 00000100:00080000:0.0:1788752861.507104:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9c9a842b5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788752861.507156:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788752861.507179:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752861.507358:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+2:2357:x1875643164794624:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 272us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752861.507365:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00010000:00010000:0.0:1788752861.507550:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788752861.868045:0:9226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.43 00010000:00010000:2.0:1788752862.122512:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752862.378396:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788752862.378423:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182649600:0@lo:400:kworker.0 00000100:00100000:2.0:1788752862.378515:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752862.378602:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182649728:0@lo:400:kworker.0 00000100:00100000:3.0:1788752862.378816:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182649472:0@lo:400:kworker.0 00000100:00100000:3.0:1788752862.378846:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752862.378867:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788752862.378872:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182649344:0@lo:400:kworker.0 00000100:00100000:3.0:1788752862.378898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752862.379026:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649600 00000100:00100000:1.0:1788752862.379033:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649600 00000100:00100000:1.0:1788752862.379084:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649472 00000100:00100000:1.0:1788752862.379088:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649472 00000100:00100000:1.0:1788752862.379108:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788752862.379116:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182649600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752862.379195:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182649600:12345-0@lo:400:kworker.0 Request processed in 79us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752862.379203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788752862.379220:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788752862.379225:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182649472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752862.379270:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182649472:12345-0@lo:400:kworker.0 Request processed in 45us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752862.379289:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788752862.379309:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752862.379341:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182649472:0@lo:400:kworker.0 00000100:00100000:2.0:1788752862.379516:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752862.379553:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182649600:0@lo:400:kworker.0 00000100:00100000:0.0:1788752862.379622:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182649856:0@lo:400:kworker.0 00000100:00100000:0.0:1788752862.379655:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752862.379685:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788752862.379690:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182649984:0@lo:400:kworker.0 00000100:00100000:0.0:1788752862.379714:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752862.379740:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649344 00000100:00100000:0.0:1788752862.379746:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649344 00000100:00100000:2.0:1788752862.379783:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649856 00000100:00100000:0.0:1788752862.379788:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788752862.379789:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649856 00000100:00100000:0.0:1788752862.379797:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182649344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752862.379826:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788752862.379834:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182649856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752862.379840:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182649344:12345-0@lo:400:kworker.0 Request processed in 43us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752862.379848:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788752862.379882:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182649856:12345-0@lo:400:kworker.0 Request processed in 47us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752862.379884:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649728 00000100:00100000:0.0:1788752862.379890:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649728 00000100:00100000:2.0:1788752862.379895:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788752862.379921:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182649984 00000100:00100000:0.0:1788752862.379925:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182649984 00000100:00100000:2.0:1788752862.379928:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788752862.379938:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182649728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752862.379948:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788752862.379956:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788752862.379979:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182649728:12345-0@lo:400:kworker.0 Request processed in 42us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752862.379987:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788752862.380002:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788752862.380008:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182649984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752862.380033:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182649984:12345-0@lo:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752862.380038:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788752862.380237:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788752862.380241:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752862.380261:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182649344:0@lo:400:kworker.0 00000100:00100000:1.0:1788752862.380400:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182650112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752862.380431:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788752862.381186:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a96a00 x1875643182649984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752862.381211:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182649984:0@lo:400:kworker.0 00000100:00100000:2.0:1788752862.381226:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182649856:0@lo:400:kworker.0 00010000:00080000:2.0:1788752862.381259:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a95500 x1875643182649728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752862.381269:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182649728:0@lo:400:kworker.0 00000100:00100000:3.0:1788752862.381943:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182650112 00000100:00100000:3.0:1788752862.381952:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182650112 00000100:00100000:1.0:1788752862.382334:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788752862.382344:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182650112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788752862.382392:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752862.382477:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182650112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752862.382483:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788752862.382535:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb5bdd500 x1875643182650112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752862.382555:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182650112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788752863.146337:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788752863.967832:0:9324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.43 00000001:00100000:1.0:1788752863.969579:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:1.0:1788752863.969590:0:6714:0:(genops.c:885:class_export_put()) final put ffff9c9bb5101800/240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:2.0:1788752863.971466:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bb5101800/240b527c-392e-42d3-b78c-b594aea00353 for lustre-OST0000 00000020:00000080:2.0:1788752863.975883:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9bb5102800 for lustre-OST0000 00010000:00010000:3.0:1788752864.171160:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752865.194955:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788752865.478165:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:1.0:1788752865.478174:0:7625:0:(genops.c:885:class_export_put()) final put ffff9c9a842b2000/240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:2.0:1788752865.478544:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a842b2000/240b527c-392e-42d3-b78c-b594aea00353 for lustre-OST0001 00000020:00000080:2.0:1788752865.478592:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9a842b5800 for lustre-OST0001 00010000:00010000:3.0:1788752866.227522:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788752866.283028:0:9423:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.43 00000100:00100000:1.0:1788752866.480183:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182650240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752866.480260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752866.480306:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182650240 00000100:00100000:3.0:1788752866.480314:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182650240 00000100:00100000:3.0:1788752866.480366:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788752866.480375:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752866.480376:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182650240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752866.480408:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752866.480462:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182650240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752866.480469:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788752866.480565:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b1f80 x1875643182650240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752866.480596:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182650240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752866.615519:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752866.615587:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752866.615875:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164794752 00000100:00100000:2.0:1788752866.615943:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164794752 00000100:00100000:2.0:1788752866.616004:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:2.0:1788752866.616014:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164794752:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752866.616091:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2359:x1875643164794752:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752866.616099:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:1.0:1788752866.619840:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164794880 00000100:00100000:1.0:1788752866.619858:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164794880 00000100:00100000:1.0:1788752866.619968:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:1.0:1788752866.619979:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164794880:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752866.620066:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164794880:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 88us (4477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752866.620073:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00080000:2.0:1788752866.620425:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788752867.243056:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752867.501069:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182650368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752867.501159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752867.501296:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182650368 00000100:00100000:0.0:1788752867.501305:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182650368 00000100:00100000:0.0:1788752867.501364:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788752867.501374:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182650368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752867.501409:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752867.501454:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182650368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752867.501461:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788752867.501484:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788752867.501532:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b5180 x1875643182650368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752867.501554:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182650368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752867.506262:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182650496:0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.506334:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752867.506399:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182650496 00000100:00100000:1.0:1788752867.506407:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182650496 00000100:00100000:1.0:1788752867.506456:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788752867.506465:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182650496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.506529:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182650496:12345-0@lo:400:kworker.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752867.506536:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788752867.506582:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182650496:0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.506624:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182650624:0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.506653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752867.506702:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182650752:0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.506741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752867.506774:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182650624 00000100:00100000:1.0:1788752867.506790:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182650624 00000100:00100000:1.0:1788752867.506817:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182650752 00000100:00100000:1.0:1788752867.506820:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182650752 00000100:00100000:1.0:1788752867.506847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788752867.506854:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182650624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.506891:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182650624:12345-0@lo:400:kworker.0 Request processed in 38us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752867.506897:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788752867.506909:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788752867.506915:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182650752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.506945:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182650752:12345-0@lo:400:kworker.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752867.506951:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788752867.506983:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182650624:0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.507005:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182650752:0@lo:400:kworker.0 00000100:00080000:1.0:1788752867.507017:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752867.507043:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182650880:0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.507070:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752867.507114:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182651008:0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.507161:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752867.507184:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651008 00000100:00100000:1.0:1788752867.507187:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651008 00000100:00100000:1.0:1788752867.507209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788752867.507215:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182651008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752867.507259:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182651008:12345-0@lo:400:kworker.0 Request processed in 43us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752867.507275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788752867.507302:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182651008:0@lo:400:kworker.0 00000100:00080000:1.0:1788752867.507315:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752867.507673:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182650880 00000100:00100000:2.0:1788752867.507678:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182650880 00000100:00100000:2.0:1788752867.507716:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788752867.507724:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182650880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752867.507777:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182650880:12345-0@lo:400:kworker.0 Request processed in 53us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752867.507793:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788752867.507860:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b0a80 x1875643182650880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752867.507871:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182650880:0@lo:400:kworker.0 00000001:02000400:2.0:1788752867.756585:0:9472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 6 23:47:46 EDT 2026 00010000:00010000:2.0:1788752868.266344:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752869.293815:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752870.320823:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752871.339771:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752871.596590:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182651136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752871.596666:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752871.596753:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651136 00000100:00100000:0.0:1788752871.596770:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651136 00000100:00100000:0.0:1788752871.596840:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788752871.596857:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182651136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788752871.596896:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752871.596943:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182651136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752871.596950:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788752871.596986:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788752871.597028:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b2680 x1875643182651136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752871.597053:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182651136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752871.729829:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752871.729942:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752871.729974:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795136 00000100:00100000:2.0:1788752871.729984:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795136 00000100:00100000:2.0:1788752871.730044:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:2.0:1788752871.730054:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164795136:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:0.0:1788752871.730094:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752871.730149:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164795136:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752871.730156:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:3.0:1788752871.730790:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795008 00000100:00100000:3.0:1788752871.730803:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795008 00000100:00100000:3.0:1788752871.730838:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 197 00000100:00100000:3.0:1788752871.731039:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2360:x1875643164795008:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752871.731085:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2360:x1875643164795008:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 240us (1267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752871.731092:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 197 00010000:00010000:1.0:1788752872.362262:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752872.618596:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182651392:0@lo:400:kworker.0 00000100:00100000:3.0:1788752872.618666:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182651648:0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.618667:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752872.618698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752872.618715:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182651904:0@lo:400:kworker.0 00000100:00100000:3.0:1788752872.618728:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788752872.618733:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182651264:0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.618735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752872.618806:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651648 00000100:00100000:0.0:1788752872.618814:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651648 00000100:00100000:0.0:1788752872.618864:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651904 00000100:00100000:0.0:1788752872.618868:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651904 00000100:00100000:0.0:1788752872.618899:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788752872.618908:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182651648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752872.621365:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788752872.621392:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182651904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.622086:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788752872.622099:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182651520:0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.622170:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752872.622230:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651392 00000100:00100000:1.0:1788752872.622238:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651392 00000100:00100000:1.0:1788752872.622281:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651520 00000100:00100000:1.0:1788752872.622283:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651520 00000100:00100000:1.0:1788752872.622322:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788752872.622329:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182651392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.622375:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182651392:12345-0@lo:400:kworker.0 Request processed in 45us (3707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752872.622382:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788752872.622398:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788752872.622405:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182651520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.622433:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182651520:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752872.622439:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788752872.622507:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182651520:0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.622518:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182651392:0@lo:400:kworker.0 00000100:00100000:1.0:1788752872.622594:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182652032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752872.622623:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752872.623428:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752872.623474:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182651776:0@lo:400:kworker.0 00000100:00100000:3.0:1788752872.623510:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752872.623550:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651776 00000100:00100000:3.0:1788752872.623556:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651776 00000100:00100000:3.0:1788752872.626946:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788752872.626962:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182651776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752872.627056:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182651776:12345-0@lo:400:kworker.0 Request processed in 98us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752872.627063:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788752872.627141:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182651776:0@lo:400:kworker.0 00000100:00100000:0.0:1788752872.630403:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182651648:12345-0@lo:400:kworker.0 Request processed in 11486us (11693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752872.630418:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788752872.630455:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788752872.630461:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752872.630477:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652032 00000100:00100000:0.0:1788752872.630492:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652032 00010000:00080000:3.0:1788752872.630500:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1ee300 x1875643182651648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752872.630521:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182651648:0@lo:400:kworker.0 00000100:00100000:0.0:1788752872.630532:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788752872.630539:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182652032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752872.630577:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752872.630629:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182652032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (8005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752872.630636:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788752872.630698:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1ef100 x1875643182652032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752872.630703:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182651264 00000100:00100000:0.0:1788752872.630707:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182651264 00000100:00100000:3.0:1788752872.630714:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182652032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752872.630735:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788752872.630742:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182651264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752872.630793:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182651264:12345-0@lo:400:kworker.0 Request processed in 51us (7368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752872.630800:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788752872.630829:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182651264:0@lo:400:kworker.0 00000100:00100000:2.0:1788752872.631642:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182651904:12345-0@lo:400:kworker.0 Request processed in 10261us (12902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752872.631651:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788752872.631823:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1eea00 x1875643182651904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752872.631835:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182651904:0@lo:400:kworker.0 00010000:00010000:3.0:1788752873.386699:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752874.410385:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752875.441227:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752876.458531:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752876.718533:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182652160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752876.718633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752876.718727:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652160 00000100:00100000:0.0:1788752876.718737:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652160 00000100:00100000:0.0:1788752876.718806:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788752876.718816:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182652160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788752876.718865:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752876.718915:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182652160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752876.718923:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788752876.718949:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788752876.718988:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1eea00 x1875643182652160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752876.719035:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182652160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752876.850658:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752876.850729:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752876.850767:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795392 00000100:00100000:1.0:1788752876.850782:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795392 00000100:00080000:2.0:1788752876.850846:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752876.850948:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1788752876.850962:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164795392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752876.850997:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795264 00000100:00100000:0.0:1788752876.851003:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795264 00000100:00100000:0.0:1788752876.851044:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:0.0:1788752876.851054:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2358:x1875643164795264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752876.851743:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164795392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 780us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752876.851752:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:0.0:1788752876.856251:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2358:x1875643164795264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3693us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752876.856271:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 199 00010000:00010000:2.0:1788752877.482437:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752877.740017:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752877.740045:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182652672:0@lo:400:kworker.0 00000100:00100000:3.0:1788752877.740081:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182652416:0@lo:400:kworker.0 00000100:00100000:2.0:1788752877.740234:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182652800:0@lo:400:kworker.0 00000100:00100000:1.0:1788752877.744440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752877.744499:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752877.744577:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652672 00000100:00100000:3.0:1788752877.744588:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652672 00000100:00100000:3.0:1788752877.744674:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788752877.744687:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182652672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752877.744766:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182652672:12345-0@lo:400:kworker.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752877.744776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788752877.744817:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182652544:0@lo:400:kworker.0 00000100:00100000:2.0:1788752877.744826:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752877.744885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752877.744916:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182653056:0@lo:400:kworker.0 00000100:00100000:3.0:1788752877.744954:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752877.744988:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652800 00000100:00100000:2.0:1788752877.744994:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652800 00000100:00100000:3.0:1788752877.745005:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652416 00000100:00100000:3.0:1788752877.745023:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652416 00000100:00100000:2.0:1788752877.745027:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653056 00000100:00100000:2.0:1788752877.745040:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653056 00000100:00100000:0.0:1788752877.745051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652544 00000100:00100000:0.0:1788752877.745055:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652544 00000100:00100000:3.0:1788752877.745068:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788752877.745077:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182652416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752877.745080:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788752877.745095:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182652800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752877.745186:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182652416:12345-0@lo:400:kworker.0 Request processed in 110us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752877.745193:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:3.0:1788752877.745223:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788752877.745229:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752877.745307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788752877.745317:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182652544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752877.745366:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182652544:12345-0@lo:400:kworker.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752877.745374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788752877.745400:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788752877.745411:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182653056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752877.745450:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182653056:12345-0@lo:400:kworker.0 Request processed in 43us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752877.745458:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788752877.745890:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182652800:12345-0@lo:400:kworker.0 Request processed in 797us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752877.745899:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788752877.745940:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb5bdce00 x1875643182652800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752877.745952:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182652544:0@lo:400:kworker.0 00000100:00100000:2.0:1788752877.745954:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182652800:0@lo:400:kworker.0 00010000:00080000:3.0:1788752877.745979:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb5bdc380 x1875643182653056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752877.745991:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182653056:0@lo:400:kworker.0 00000100:00100000:3.0:1788752877.746281:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182652416:0@lo:400:kworker.0 00000100:00100000:3.0:1788752877.746293:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182652928:0@lo:400:kworker.0 00000100:00100000:3.0:1788752877.746332:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752877.746592:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182652672:0@lo:400:kworker.0 00000100:00100000:0.0:1788752877.746602:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182652288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788752877.746623:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652928 00000100:00100000:2.0:1788752877.746631:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652928 00000100:00100000:0.0:1788752877.746634:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752877.746675:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182652288 00000100:00100000:0.0:1788752877.746679:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182652288 00000100:00100000:2.0:1788752877.746685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788752877.746693:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182652928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752877.746703:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788752877.746709:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182652288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752877.746744:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752877.746779:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182652288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752877.746786:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788752877.746821:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1eed80 x1875643182652288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752893 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752877.747158:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182652288:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788752877.748064:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752877.749805:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182652928:12345-0@lo:400:kworker.0 Request processed in 3102us (3462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752877.749821:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788752877.749839:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182652928:0@lo:400:kworker.0 00010000:00010000:1.0:1788752878.506894:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752879.533533:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752880.554414:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752881.578375:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752881.835682:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182653184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752881.835777:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752881.835923:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653184 00000100:00100000:2.0:1788752881.835933:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653184 00000100:00100000:2.0:1788752881.836037:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788752881.836051:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182653184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788752881.836098:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752881.836186:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182653184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752881.836193:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788752881.836285:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1ec700 x1875643182653184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788752881.836288:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752881.836313:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182653184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752881.973227:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752881.973336:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752881.974733:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795648 00000100:00100000:1.0:1788752881.974751:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795648 00000100:00100000:1.0:1788752881.974853:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:1.0:1788752881.974867:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164795648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752881.974981:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164795648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 116us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752881.974990:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00080000:3.0:1788752881.976043:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752881.980597:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795520 00000100:00100000:0.0:1788752881.980615:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795520 00000100:00100000:0.0:1788752881.980687:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 201 00000100:00100000:0.0:1788752881.980699:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2361:x1875643164795520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752881.980801:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2361:x1875643164795520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 103us (7585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752881.980809:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 201 00000001:02000400:0.0:1788752882.316453:0:10104:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:48:01 (1788752881) === 00010000:00010000:1.0:1788752882.602294:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752882.858559:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182653440:0@lo:400:kworker.0 00000100:00100000:3.0:1788752882.858654:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752882.858733:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182653952:0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.858949:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182653696:0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.859005:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752882.859048:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788752882.859054:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182653312:0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.859094:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752882.859117:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182653824:0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.859174:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752882.859212:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653696 00000100:00100000:0.0:1788752882.859222:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653696 00000100:00100000:0.0:1788752882.859278:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788752882.859289:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182653696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.859354:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182653696:12345-0@lo:400:kworker.0 Request processed in 66us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.859362:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788752882.859389:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653312 00000100:00100000:0.0:1788752882.859392:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653312 00000100:00100000:0.0:1788752882.859416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788752882.859423:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182653312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.859460:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182653312:12345-0@lo:400:kworker.0 Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.859466:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788752882.859529:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182653312:0@lo:400:kworker.0 00010000:00080000:0.0:1788752882.859547:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb5bdc000 x1875643182653696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752882.859560:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182653696:0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.859614:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653440 00000100:00100000:0.0:1788752882.859626:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653440 00000100:00100000:0.0:1788752882.859656:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653824 00000100:00100000:0.0:1788752882.859659:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653824 00000100:00100000:0.0:1788752882.859688:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788752882.859693:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182653440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.859729:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182653440:12345-0@lo:400:kworker.0 Request processed in 36us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.859735:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788752882.859746:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788752882.859766:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182653824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.860048:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182653824:12345-0@lo:400:kworker.0 Request processed in 283us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.860055:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788752882.860078:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182653568:0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.860103:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752882.860165:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653568 00000100:00100000:0.0:1788752882.860169:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653568 00000100:00100000:0.0:1788752882.860189:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788752882.860195:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182653568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.860226:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182653568:12345-0@lo:400:kworker.0 Request processed in 31us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.860232:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788752882.860260:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182653568:0@lo:400:kworker.0 00000100:00100000:0.0:1788752882.860284:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182653824:0@lo:400:kworker.0 00000100:00080000:0.0:1788752882.860324:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752882.861258:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752882.861317:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182653440:0@lo:400:kworker.0 00000100:00100000:3.0:1788752882.861350:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788752882.861359:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182654080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752882.861393:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752882.861427:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654080 00000100:00100000:3.0:1788752882.861433:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654080 00000100:00100000:2.0:1788752882.861680:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182653952 00000100:00100000:2.0:1788752882.861685:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182653952 00000100:00100000:2.0:1788752882.861717:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788752882.861738:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182653952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752882.861911:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182653952:12345-0@lo:400:kworker.0 Request processed in 184us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752882.861919:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788752882.861951:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788752882.861958:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182654080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788752882.861991:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752882.862023:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182654080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752882.862029:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788752882.862065:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788752882.862095:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1edc00 x1875643182654080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752898 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752882.862114:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182654080:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788752882.862162:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb5bdf100 x1875643182653952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752882.862171:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182653952:0@lo:400:kworker.0 00000100:00100000:1.0:1788752882.862430:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752882.862931:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795776 00000100:00100000:0.0:1788752882.862954:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795776 00000100:00100000:0.0:1788752882.863003:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:0.0:1788752882.863012:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:8126:x1875643164795776:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788752882.863027:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752882.863050:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc9200/0x80c8383f4848fe46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ee95 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752882.863085:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc9200/0x80c8383f4848fe46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee95 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752882.863098:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc9200/0x80c8383f4848fe46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee95 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752882.863110:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9200, rc 0) 00000100:00100000:0.0:1788752882.863208:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8126:x1875643164795776:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 196us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.863215:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:0.0:1788752882.889609:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752882.890275:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164795904 00000100:00100000:2.0:1788752882.890299:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164795904 00000100:00100000:2.0:1788752882.890372:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:2.0:1788752882.890385:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8126:x1875643164795904:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788752882.890914:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8126:x1875643164795904:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 530us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752882.890934:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:2.0:1788752882.894826:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752882.894975:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796032 00000100:00100000:1.0:1788752882.894989:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796032 00000100:00100000:1.0:1788752882.895054:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:1.0:1788752882.895065:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8126:x1875643164796032:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788752882.895434:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8126:x1875643164796032:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 368us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752882.895444:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:1.0:1788752882.915204:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752882.915583:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796160 00000100:00100000:0.0:1788752882.915596:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796160 00000100:00100000:0.0:1788752882.915667:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:0.0:1788752882.915679:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8130:x1875643164796160:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788752882.916054:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8130:x1875643164796160:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 376us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.916064:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:0.0:1788752882.945866:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752882.946038:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796288 00000100:00100000:2.0:1788752882.946052:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796288 00000100:00100000:2.0:1788752882.946177:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:2.0:1788752882.946189:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8130:x1875643164796288:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788752882.946524:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8130:x1875643164796288:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 337us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752882.946533:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:2.0:1788752882.963833:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752882.966340:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796416 00000100:00100000:1.0:1788752882.966359:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796416 00000100:00100000:1.0:1788752882.966458:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 208 00000100:00100000:1.0:1788752882.966472:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:8126:x1875643164796416:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788752882.966495:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752882.966522:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe270e00/0x80c8383f4848fe4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852eebf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752882.966566:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe270e00/0x80c8383f4848fe4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eebf expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752882.966579:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe270e00/0x80c8383f4848fe4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eebf expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752882.966616:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270e00, rc 0) 00000100:00100000:1.0:1788752882.966711:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:8126:x1875643164796416:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 241us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752882.966720:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 208 00000100:00100000:1.0:1788752882.983399:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752882.983666:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796544 00000100:00100000:0.0:1788752882.983697:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796544 00000100:00100000:0.0:1788752882.983770:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:0.0:1788752882.983782:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:8126:x1875643164796544:12345-192.168.203.5@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788752882.983817:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788752882.983838:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788752882.983842:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788752882.983846:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788752882.983849:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788752882.991486:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:8126:x1875643164796544:12345-192.168.203.5@tcp:256:mount.lustre.0 Request processed in 7683us (8076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752882.991505:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:1.0:1788752882.997304:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752882.997430:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796672 00000100:00100000:0.0:1788752882.997444:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796672 00000100:00100000:0.0:1788752882.997523:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:0.0:1788752882.997535:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:8126:x1875643164796672:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788752882.997559:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752882.997597:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852eec6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752882.997635:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752882.997647:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752882.997658:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752882.997738:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8126:x1875643164796672:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 204us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752882.997745:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:2.0:1788752883.009302:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752883.009416:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796800 00000100:00100000:3.0:1788752883.009430:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796800 00000100:00100000:3.0:1788752883.009697:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:3.0:1788752883.009711:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8126:x1875643164796800:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788752883.010278:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8126:x1875643164796800:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 568us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752883.010287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:0.0:1788752883.013165:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752883.013339:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164796928 00000100:00100000:2.0:1788752883.013353:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164796928 00000100:00100000:2.0:1788752883.013458:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 212 00000100:00100000:2.0:1788752883.013480:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8126:x1875643164796928:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788752883.014079:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8126:x1875643164796928:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 600us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752883.014089:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 212 00000100:00100000:1.0:1788752883.018030:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752883.019357:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797056 00000100:00100000:0.0:1788752883.019395:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797056 00000100:00100000:0.0:1788752883.019454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:0.0:1788752883.019477:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8134:x1875643164797056:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788752883.020344:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8134:x1875643164797056:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 876us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752883.020356:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:1.0:1788752883.031600:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752883.031706:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797184 00000100:00100000:2.0:1788752883.031721:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797184 00000100:00100000:2.0:1788752883.031835:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:2.0:1788752883.031847:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8134:x1875643164797184:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788752883.032211:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:8134:x1875643164797184:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 365us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752883.032230:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:1.0:1788752883.044275:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752883.044321:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752883.044424:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797312 00000100:00100000:0.0:1788752883.044437:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797312 00000100:00100000:0.0:1788752883.044489:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797696 00000100:00100000:0.0:1788752883.044492:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797696 00000100:00100000:0.0:1788752883.044556:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:0.0:1788752883.044582:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164797696:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752883.044683:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164797696:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752883.044691:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:0.0:1788752883.044713:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:0.0:1788752883.044718:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1875643164797312:12345-192.168.203.5@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788752883.044750:0:5832:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from d6fb571c-e1e0-40af-9c1e-57602ced3328@192.168.203.5@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:0.0:1788752883.044807:0:5832:0:(genops.c:1384:class_connect()) connect: client d6fb571c-e1e0-40af-9c1e-57602ced3328, cookie 0x80c8383f4848fe5b 00000004:00100000:0.0:1788752883.044850:0:5832:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788752883.045235:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9c9b88aa5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788752883.045275:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:2357:x1875643164797312:12345-192.168.203.5@tcp:38:mount.lustre.0 Request processed in 555us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752883.045283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00080000:2.0:1788752883.045429:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752883.056534:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752883.056594:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752883.056695:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797440 00000100:00100000:2.0:1788752883.056707:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797440 00000100:00100000:2.0:1788752883.056808:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797568 00000100:00100000:2.0:1788752883.056812:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797568 00000100:00100000:2.0:1788752883.056835:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1788752883.056847:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+7:0:x1875643164797440:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788752883.056907:0:7899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788752883.057965:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752883.058010:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1788752883.058039:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+7:8126:x1875643164797568:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788752883.058072:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788752883.059097:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+7:8126:x1875643164797568:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 1071us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752883.059109:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1788752883.061272:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:0:x1875643164797440:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 4415us (4738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752883.061287:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1788752883.062175:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752883.063082:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797824 00000100:00100000:3.0:1788752883.063096:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797824 00000100:00100000:3.0:1788752883.063196:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1788752883.063207:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:8126:x1875643164797824:12345-192.168.203.5@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788752883.063322:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:8126:x1875643164797824:12345-192.168.203.5@tcp:40:mount.lustre.0 Request processed in 117us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752883.063330:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1788752883.066444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752883.066487:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752883.066577:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798208 00000100:00100000:2.0:1788752883.066589:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798208 00000100:00100000:2.0:1788752883.066658:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:2.0:1788752883.066668:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:8126:x1875643164798208:12345-192.168.203.5@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788752883.066815:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788752883.066904:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:8126:x1875643164798208:12345-192.168.203.5@tcp:33:mount.lustre.0 Request processed in 237us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752883.066912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:1.0:1788752883.067335:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752883.081609:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164797952 00000100:00100000:0.0:1788752883.081650:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164797952 00000100:00100000:0.0:1788752883.081732:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798080 00000100:00100000:0.0:1788752883.081736:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798080 00000100:00100000:2.0:1788752883.082037:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1788752883.082049:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875643164797952:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788752883.082098:0:6690:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from d6fb571c-e1e0-40af-9c1e-57602ced3328@192.168.203.5@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1788752883.082179:0:6690:0:(genops.c:1384:class_connect()) connect: client d6fb571c-e1e0-40af-9c1e-57602ced3328, cookie 0x80c8383f4848fe62 00002000:00100000:2.0:1788752883.082200:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d6fb571c-e1e0-40af-9c1e-57602ced3328/ffff9c9bbe08a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788752883.082223:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788752883.082523:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788752883.082577:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe08e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788752883.084944:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:0.0:1788752883.084958:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875643164798080:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788752883.085002:0:9256:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from d6fb571c-e1e0-40af-9c1e-57602ced3328@192.168.203.5@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:0.0:1788752883.085043:0:9256:0:(genops.c:1384:class_connect()) connect: client d6fb571c-e1e0-40af-9c1e-57602ced3328, cookie 0x80c8383f4848fe69 00002000:00100000:0.0:1788752883.085057:0:9256:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d6fb571c-e1e0-40af-9c1e-57602ced3328/ffff9c9b88aa3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788752883.085069:0:9256:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788752883.085364:0:9256:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788752883.085403:0:9256:0:(import.c:65:import_set_state_nolock()) ffff9c9b88aa0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788752883.085481:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:2357:x1875643164798080:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 522us (18146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752883.085490:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1788752883.085562:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:2357:x1875643164797952:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 623us (16183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752883.085571:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00010000:00010000:2.0:1788752883.626427:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788752884.496344:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d6fb571c-e1e0-40af-9c1e-57602ced3328 00010000:00010000:1.0:1788752884.650336:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752885.674453:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788752886.020463:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d6fb571c-e1e0-40af-9c1e-57602ced3328 00000001:00100000:1.0:1788752886.026010:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d6fb571c-e1e0-40af-9c1e-57602ced3328 00010000:00010000:0.0:1788752886.718046:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752886.956637:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788752886.956662:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182654208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752886.956733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752886.956818:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654208 00000100:00100000:2.0:1788752886.956826:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654208 00000100:00100000:2.0:1788752886.956888:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788752886.956899:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182654208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788752886.956935:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752886.956982:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182654208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752886.956989:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788752886.957038:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a97100 x1875643182654208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752886.957058:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182654208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788752886.957100:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788752887.722808:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752887.981045:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182654336:0@lo:400:kworker.0 00000100:00100000:1.0:1788752887.981159:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752887.981215:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182654976:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.981228:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654336 00000100:00100000:2.0:1788752887.981236:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654336 00000100:00100000:1.0:1788752887.981243:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752887.981269:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788752887.981275:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788752887.981275:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182654592:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.981284:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182654336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752887.981295:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752887.981310:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182655104:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.981341:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182654336:12345-0@lo:400:kworker.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752887.981347:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752887.981349:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788752887.981372:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182654336:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.981381:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654976 00000100:00100000:2.0:1788752887.981385:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654976 00000100:00080000:1.0:1788752887.981405:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752887.981413:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654592 00000100:00100000:2.0:1788752887.981416:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654592 00000100:00100000:2.0:1788752887.981444:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788752887.981451:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182654976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752887.981469:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182654464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788752887.981490:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182654976:12345-0@lo:400:kworker.0 Request processed in 40us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752887.981497:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788752887.981498:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752887.981511:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788752887.981516:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182654848:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.981517:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182654592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752887.981535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752887.981539:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182654592:12345-0@lo:400:kworker.0 Request processed in 22us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752887.981544:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788752887.981552:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788752887.981558:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182654720:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.981570:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182654592:0@lo:400:kworker.0 00000100:00100000:3.0:1788752887.981575:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752887.981579:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182654976:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.981609:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654464 00000100:00100000:3.0:1788752887.981610:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182655104 00000100:00100000:3.0:1788752887.981613:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182655104 00000100:00100000:2.0:1788752887.981613:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654464 00000100:00100000:0.0:1788752887.981721:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654720 00000100:00100000:0.0:1788752887.981725:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654720 00000100:00100000:1.0:1788752887.982327:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182654848 00000100:00100000:1.0:1788752887.982332:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182654848 00000100:00100000:1.0:1788752887.982368:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788752887.982375:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182654848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.982418:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788752887.982424:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182654848:12345-0@lo:400:kworker.0 Request processed in 51us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752887.982430:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788752887.982470:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752887.982474:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788752887.982475:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752887.982481:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182654720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752887.982517:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182654720:12345-0@lo:400:kworker.0 Request processed in 36us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752887.982523:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788752887.985611:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788752887.985625:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182655104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752887.985716:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182655104:12345-0@lo:400:kworker.0 Request processed in 94us (4366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752887.985723:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788752887.985778:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182654720:0@lo:400:kworker.0 00010000:00080000:3.0:1788752887.985795:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a94a80 x1875643182654848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752887.985807:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182654848:0@lo:400:kworker.0 00010000:00080000:3.0:1788752887.986049:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbda1fb80 x1875643182655104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752887.986083:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182655104:0@lo:400:kworker.0 00000100:00100000:2.0:1788752887.990969:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182654464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788752887.992308:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752887.992436:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182654464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10008us (10934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752887.992461:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788752887.992599:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbe1eed80 x1875643182654464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752903 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752887.992627:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182654464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752888.127051:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752888.127094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752888.127183:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752888.127206:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752888.127231:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752888.127243:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798592 00000100:00100000:1.0:1788752888.127253:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798848 00000100:00100000:0.0:1788752888.127253:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798592 00000100:00100000:1.0:1788752888.127256:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798848 00000100:00100000:3.0:1788752888.127316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798464 00000100:00100000:3.0:1788752888.127321:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798464 00000100:00100000:1.0:1788752888.127379:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798720 00000100:00100000:1.0:1788752888.127383:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798720 00000100:00100000:2.0:1788752888.127504:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798336 00000100:00100000:2.0:1788752888.127508:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798336 00000100:00100000:2.0:1788752888.127540:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:2.0:1788752888.127549:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164798336:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752888.127632:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164798336:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 83us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752888.127639:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:2.0:1788752888.127794:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:2.0:1788752888.127803:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164798848:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752888.127838:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164798848:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752888.127856:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1788752888.133646:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1788752888.133662:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164798592:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752888.133700:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:3.0:1788752888.133707:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164798464:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752888.133764:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164798464:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 56us (6556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752888.133771:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00080000:2.0:1788752888.133915:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788752888.133921:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788752888.133924:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788752888.137996:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:1.0:1788752888.138018:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164798720:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752888.142898:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164798592:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 9069us (15631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752888.142914:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:1.0:1788752888.144265:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164798720:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6246us (17021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752888.144292:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00010000:00010000:1.0:1788752888.746413:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788752889.686813:0:10303:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788752889.771306:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752890.794312:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752891.818588:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752892.076463:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788752892.076528:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182655232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752892.076596:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752892.076819:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182655232 00000100:00100000:1.0:1788752892.076827:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182655232 00000100:00100000:1.0:1788752892.076979:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788752892.076988:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182655232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788752892.077026:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752892.077091:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182655232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752892.077099:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788752892.077178:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788752892.077395:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a94700 x1875643182655232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752908 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752892.077420:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182655232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788752892.842228:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752893.099322:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788752893.099345:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182655360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752893.099411:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752893.099500:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182655360 00000100:00100000:1.0:1788752893.099508:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182655360 00000100:00100000:1.0:1788752893.099576:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788752893.099586:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182655360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788752893.099621:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752893.099667:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182655360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752893.099674:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788752893.099710:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88a96300 x1875643182655360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752909 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752893.099727:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182655360:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788752893.099779:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788752893.100679:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182655488:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.100724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752893.100768:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182656000:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.100795:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752893.100817:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788752893.100823:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182655616:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.100856:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752893.100888:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182655488 00000100:00100000:1.0:1788752893.100894:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182655488 00000100:00100000:1.0:1788752893.100927:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788752893.100934:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182655488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.100974:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182655488:12345-0@lo:400:kworker.0 Request processed in 41us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752893.100981:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788752893.101008:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656000 00000100:00100000:1.0:1788752893.101012:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656000 00000100:00100000:1.0:1788752893.101043:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182655616 00000100:00100000:1.0:1788752893.101045:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182655616 00000100:00100000:1.0:1788752893.101064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788752893.101080:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182656000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101112:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182656000:12345-0@lo:400:kworker.0 Request processed in 42us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752893.101118:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788752893.101152:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788752893.101158:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182655616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101185:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182655616:12345-0@lo:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752893.101191:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1788752893.101215:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752893.101234:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182655744:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752893.101275:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752893.101280:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182655872:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101307:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752893.101327:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182655744 00000100:00100000:1.0:1788752893.101331:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182655744 00000100:00100000:1.0:1788752893.101356:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788752893.101362:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182655744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101405:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182655744:12345-0@lo:400:kworker.0 Request processed in 43us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752893.101411:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788752893.101428:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752893.101449:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182655616:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101458:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182655488:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101466:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182656000:0@lo:400:kworker.0 00000100:00100000:1.0:1788752893.101496:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182655744:0@lo:400:kworker.0 00000100:00100000:2.0:1788752893.101665:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182655872 00000100:00100000:2.0:1788752893.101669:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182655872 00000100:00100000:2.0:1788752893.101705:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788752893.101712:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182655872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752893.101758:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182655872:12345-0@lo:400:kworker.0 Request processed in 46us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752893.101764:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788752893.105272:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b2680 x1875643182655872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752893.105304:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182655872:0@lo:400:kworker.0 00000100:00100000:2.0:1788752893.239321:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752893.239443:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164798976 00000100:00100000:3.0:1788752893.239453:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164798976 00000100:00100000:2.0:1788752893.239596:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752893.239625:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752893.239646:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752893.239714:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752893.239739:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164799232 00000100:00100000:2.0:1788752893.239743:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164799232 00000100:00100000:2.0:1788752893.239783:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164799104 00000100:00100000:2.0:1788752893.239786:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164799104 00000100:00100000:2.0:1788752893.239807:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:2.0:1788752893.239816:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164799232:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752893.239981:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:3.0:1788752893.239990:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164798976:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752893.240050:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164798976:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 61us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752893.240067:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:2.0:1788752893.240335:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164799232:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 518us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752893.240344:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:2.0:1788752893.240437:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:2.0:1788752893.240446:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164799104:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752893.240480:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164799104:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752893.240487:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:2.0:1788752893.240803:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164799488 00000100:00100000:2.0:1788752893.240809:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164799488 00000100:00100000:2.0:1788752893.240959:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164799360 00000100:00100000:2.0:1788752893.240964:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164799360 00000100:00100000:0.0:1788752893.241106:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:0.0:1788752893.241118:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164799488:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752893.241192:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164799488:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 77us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752893.241199:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:0.0:1788752893.241216:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:0.0:1788752893.241223:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164799360:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752893.241247:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164799360:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752893.241253:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00080000:2.0:1788752893.243016:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788752893.243025:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788752893.243037:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788752893.867845:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752894.890449:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752895.915422:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752896.940963:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752897.194429:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182656128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752897.194532:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752897.194729:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656128 00000100:00100000:1.0:1788752897.194741:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656128 00000100:00100000:1.0:1788752897.194830:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788752897.194841:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182656128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788752897.194963:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752897.195112:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182656128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 272us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752897.195142:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788752897.195218:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbddf4e00 x1875643182656128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752913 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752897.195243:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182656128:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788752897.195288:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788752897.963296:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752898.218363:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788752898.218392:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182656256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752898.218475:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752898.218549:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656256 00000100:00100000:1.0:1788752898.218558:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656256 00000100:00100000:1.0:1788752898.218623:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788752898.218634:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182656256:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752898.218855:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182656512:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.218893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752898.218917:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788752898.218922:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182656640:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.218942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752898.218971:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656512 00000100:00100000:3.0:1788752898.218975:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656512 00000100:00100000:3.0:1788752898.219007:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656640 00000100:00100000:3.0:1788752898.219010:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656640 00000100:00100000:3.0:1788752898.219030:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788752898.219050:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182656512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219099:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182656512:12345-0@lo:400:kworker.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752898.219107:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788752898.219155:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788752898.219163:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182656640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219190:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182656640:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752898.219196:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788752898.219253:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182656640:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219264:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182656512:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219294:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182656384:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219330:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752898.219365:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182656896:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219386:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752898.219401:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788752898.219406:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182656768:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219429:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752898.219456:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656384 00000100:00100000:3.0:1788752898.219461:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656384 00000100:00100000:3.0:1788752898.219485:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788752898.219491:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3304:x1875643182656384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219524:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3304:x1875643182656384:12345-0@lo:400:kworker.0 Request processed in 33us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752898.219530:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788752898.219555:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656768 00000100:00100000:3.0:1788752898.219559:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656768 00000100:00100000:3.0:1788752898.219586:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788752898.219594:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182656768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.219624:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182656768:12345-0@lo:400:kworker.0 Request processed in 32us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752898.219631:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788752898.219654:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182656896 00000100:00100000:3.0:1788752898.219657:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182656896 00002000:00000024:1.0:1788752898.219869:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752898.219911:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182656256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1279us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752898.219918:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788752898.219940:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788752898.219945:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788752898.220165:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef31500 x1875643182656768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752898.220179:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182656768:0@lo:400:kworker.0 00000100:00100000:2.0:1788752898.220190:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe551180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182656384:0@lo:400:kworker.0 00010000:00080000:2.0:1788752898.220203:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbddf6a00 x1875643182656256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752914 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752898.220220:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182656256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752898.222001:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788752898.222022:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182656896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.222162:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182656896:12345-0@lo:400:kworker.0 Request processed in 149us (2774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752898.222170:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788752898.222226:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182656896:0@lo:400:kworker.0 00000100:00100000:3.0:1788752898.354522:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752898.354574:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752898.354615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752898.354630:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164799616 00000100:00100000:0.0:1788752898.354644:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164799616 00000100:00100000:3.0:1788752898.354661:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752898.354773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164799872 00000100:00100000:2.0:1788752898.354778:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164799872 00000100:00100000:2.0:1788752898.354845:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164799744 00000100:00100000:2.0:1788752898.354848:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164799744 00000100:00100000:0.0:1788752898.354853:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:0.0:1788752898.354868:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164799616:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752898.354879:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:2.0:1788752898.354889:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164799872:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752898.354967:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164799616:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 103us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752898.354975:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:1.0:1788752898.354993:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800128 00000100:00100000:1.0:1788752898.354999:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800128 00000100:00100000:1.0:1788752898.355059:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:1.0:1788752898.355067:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164800128:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752898.355383:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164799872:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 495us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752898.355393:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:2.0:1788752898.355414:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:2.0:1788752898.355421:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164799744:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752898.355448:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164799744:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 28us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752898.355467:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:3.0:1788752898.356428:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752898.357157:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800000 00000100:00100000:2.0:1788752898.357169:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800000 00000100:00080000:3.0:1788752898.357197:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788752898.357203:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788752898.357208:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752898.357228:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:2.0:1788752898.357239:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164800000:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752898.357323:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164800000:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 85us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752898.357332:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:1.0:1788752898.358919:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164800128:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3842us (4293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752898.358942:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00010000:00010000:3.0:1788752898.996797:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752900.010995:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752901.034426:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752902.059631:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752902.314976:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788752902.315000:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182657024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752902.315078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752902.315158:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657024 00000100:00100000:3.0:1788752902.315165:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657024 00000100:00100000:3.0:1788752902.316107:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788752902.316146:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182657024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752902.316182:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752902.316602:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182657024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 483us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752902.316611:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788752902.316636:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788752902.316683:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef33480 x1875643182657024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752902.316706:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182657024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788752903.082229:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752903.341443:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182657536:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.341524:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752903.341582:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788752903.341599:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182657152:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.341633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752903.341665:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182657664:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.341690:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752903.341718:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182657280:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.341741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752903.341756:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182657792:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.341776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752903.341795:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752903.341800:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182657408:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.341818:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752903.341844:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657536 00000100:00100000:1.0:1788752903.341851:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657536 00000100:00100000:1.0:1788752903.341892:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657792 00000100:00100000:1.0:1788752903.341895:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657792 00000100:00100000:1.0:1788752903.341921:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788752903.341930:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182657536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.341981:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182657536:12345-0@lo:400:kworker.0 Request processed in 51us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752903.341988:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788752903.342012:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788752903.342018:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182657792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.342043:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182657792:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752903.342058:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788752903.342073:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657664 00000100:00100000:1.0:1788752903.342076:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657664 00000100:00100000:1.0:1788752903.342097:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657280 00000100:00100000:1.0:1788752903.342099:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657280 00000100:00100000:1.0:1788752903.342107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657408 00000100:00100000:1.0:1788752903.342109:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657408 00000100:00100000:1.0:1788752903.342119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788752903.342150:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182657664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.342187:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182657664:12345-0@lo:400:kworker.0 Request processed in 38us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752903.342193:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788752903.342202:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788752903.342207:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182657280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.342226:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182657280:12345-0@lo:400:kworker.0 Request processed in 19us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752903.342231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788752903.342239:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788752903.342244:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182657408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.342263:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182657408:12345-0@lo:400:kworker.0 Request processed in 19us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752903.342268:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788752903.342305:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182657408:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.342313:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182657280:0@lo:400:kworker.0 00010000:00080000:1.0:1788752903.342324:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbddf4a80 x1875643182657792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752903.342341:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182657792:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.342370:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182657664:0@lo:400:kworker.0 00010000:00080000:1.0:1788752903.342379:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbddf5500 x1875643182657536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752903.342387:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182657536:0@lo:400:kworker.0 00000100:00100000:3.0:1788752903.343097:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657152 00000100:00100000:3.0:1788752903.343107:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657152 00000100:00100000:3.0:1788752903.343167:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788752903.343183:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182657152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752903.343236:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182657152:12345-0@lo:400:kworker.0 Request processed in 55us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752903.343242:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1788752903.343275:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788752903.343279:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788752903.344505:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182657152:0@lo:400:kworker.0 00000100:00100000:1.0:1788752903.348579:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752903.348610:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182657920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752903.348698:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752903.348747:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182657920 00000100:00100000:1.0:1788752903.348754:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182657920 00000100:00100000:1.0:1788752903.348800:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788752903.348809:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182657920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788752903.348843:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752903.348887:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182657920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752903.348894:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788752903.348930:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbddf6680 x1875643182657920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752919 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752903.348950:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182657920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788752903.478480:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752903.478524:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752903.478541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752903.478567:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752903.479299:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752903.479336:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800640 00000100:00100000:2.0:1788752903.479345:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800640 00000100:00100000:2.0:1788752903.479400:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800768 00000100:00100000:2.0:1788752903.479404:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800768 00000100:00100000:2.0:1788752903.479429:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1788752903.479440:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2357:x1875643164800640:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:2.0:1788752903.479471:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fe62 00000100:00080000:2.0:1788752903.479481:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe08e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788752903.479518:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788752903.480754:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800384 00000100:00100000:0.0:1788752903.480766:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800384 00000100:00100000:0.0:1788752903.480814:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800512 00000100:00100000:0.0:1788752903.480818:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800512 00000100:00100000:0.0:1788752903.480847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:0.0:1788752903.480856:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164800384:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752903.480936:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164800384:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 80us (2469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752903.480943:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:0.0:1788752903.480962:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:0.0:1788752903.480969:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164800512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752903.480995:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164800512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (2452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752903.481011:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:0.0:1788752903.481033:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800256 00000100:00100000:0.0:1788752903.481037:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800256 00000100:00100000:0.0:1788752903.481060:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 222 00000100:00100000:0.0:1788752903.481067:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164800256:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752903.481090:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164800256:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 24us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752903.481114:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 222 00000100:00100000:2.0:1788752903.481540:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+2:2357:x1875643164800640:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 2100us (2969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752903.481549:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1788752903.481575:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1788752903.481583:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb531cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2357:x1875643164800768:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:2.0:1788752903.481602:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fe69 00000100:00080000:2.0:1788752903.481611:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9c9b88aa0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788752903.483673:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788752903.497424:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb531cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+2:2357:x1875643164800768:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 15828us (18114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752903.497440:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00080000:2.0:1788752903.497622:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788752903.497627:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788752903.497630:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788752903.499676:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752903.499686:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752904.106281:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788752904.925813:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d6fb571c-e1e0-40af-9c1e-57602ced3328 00000020:00000080:3.0:1788752904.925824:0:6714:0:(genops.c:885:class_export_put()) final put ffff9c9bbe08a000/d6fb571c-e1e0-40af-9c1e-57602ced3328 00000020:00000080:1.0:1788752904.925960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbe08a000/d6fb571c-e1e0-40af-9c1e-57602ced3328 for lustre-OST0000 00000020:00000080:1.0:1788752904.926026:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9bbe08e800 for lustre-OST0000 00010000:00010000:2.0:1788752905.130314:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788752905.373983:0:11003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788752906.154448:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788752906.542572:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d6fb571c-e1e0-40af-9c1e-57602ced3328 00000020:00000080:1.0:1788752906.542580:0:7625:0:(genops.c:885:class_export_put()) final put ffff9c9b88aa3800/d6fb571c-e1e0-40af-9c1e-57602ced3328 00000020:00000080:0.0:1788752906.542663:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88aa3800/d6fb571c-e1e0-40af-9c1e-57602ced3328 for lustre-OST0001 00000020:00000080:0.0:1788752906.545215:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b88aa0800 for lustre-OST0001 00010000:00010000:1.0:1788752907.178293:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752907.435361:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788752907.435395:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182658048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752907.435496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752907.435583:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658048 00000100:00100000:3.0:1788752907.435593:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658048 00000100:00100000:3.0:1788752907.435671:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788752907.435682:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182658048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752907.435732:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752907.435785:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182658048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752907.435793:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788752907.435858:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef33480 x1875643182658048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752907.435881:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182658048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788752907.436097:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788752908.211872:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752908.459108:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182658304:0@lo:400:kworker.0 00000100:00100000:0.0:1788752908.459108:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182658176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752908.459352:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182658432:0@lo:400:kworker.0 00000100:00100000:1.0:1788752908.462880:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182658560:0@lo:400:kworker.0 00000100:00100000:2.0:1788752908.470062:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752908.470078:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752908.470394:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658176 00000100:00100000:0.0:1788752908.470407:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658176 00000100:00100000:0.0:1788752908.470495:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788752908.470507:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182658176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752908.470575:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752908.470658:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182658176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752908.470667:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788752908.470710:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752908.470762:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658304 00000100:00100000:0.0:1788752908.470767:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658304 00000100:00100000:0.0:1788752908.470793:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788752908.470800:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182658304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752908.470839:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182658304:12345-0@lo:400:kworker.0 Request processed in 40us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752908.470845:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788752908.471593:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182658304:0@lo:400:kworker.0 00000100:00100000:2.0:1788752908.471632:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182658816:0@lo:400:kworker.0 00000100:00100000:2.0:1788752908.471696:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752908.471789:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658816 00000100:00100000:0.0:1788752908.471798:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658816 00000100:00100000:0.0:1788752908.471935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788752908.471946:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182658816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752908.472044:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182658816:12345-0@lo:400:kworker.0 Request processed in 100us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752908.472053:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1788752908.472116:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbddf6680 x1875643182658176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752924 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752908.472176:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182658176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752908.472217:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182658688:0@lo:400:kworker.0 00000100:00100000:0.0:1788752908.472254:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752908.472300:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658688 00000100:00100000:0.0:1788752908.472304:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658688 00000100:00100000:0.0:1788752908.472347:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788752908.472355:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182658688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752908.472393:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182658688:12345-0@lo:400:kworker.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752908.472400:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788752908.472430:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef30e00 x1875643182658688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752908.472440:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182658688:0@lo:400:kworker.0 00000100:00100000:0.0:1788752908.472619:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182658816:0@lo:400:kworker.0 00000100:00100000:3.0:1788752908.472775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752908.472822:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182658944:0@lo:400:kworker.0 00000100:00100000:3.0:1788752908.472873:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752908.473494:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658432 00000100:00100000:0.0:1788752908.473503:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658432 00000100:00100000:0.0:1788752908.473561:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788752908.473570:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182658432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752908.473636:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182658432:12345-0@lo:400:kworker.0 Request processed in 67us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752908.473653:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788752908.474214:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752908.474242:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658944 00000100:00100000:2.0:1788752908.474251:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658944 00000100:00100000:2.0:1788752908.474305:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788752908.474315:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182658944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752908.474635:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182658944:12345-0@lo:400:kworker.0 Request processed in 321us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752908.474662:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788752908.475578:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182658432:0@lo:400:kworker.0 00010000:00080000:3.0:1788752908.475600:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef30380 x1875643182658944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752908.475611:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182658944:0@lo:400:kworker.0 00000100:00100000:1.0:1788752908.476983:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752908.477264:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182658560 00000100:00100000:0.0:1788752908.477277:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182658560 00000100:00080000:2.0:1788752908.477332:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752908.477392:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788752908.477406:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182658560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752908.477538:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182658560:12345-0@lo:400:kworker.0 Request processed in 135us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752908.477547:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788752908.482962:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182658560:0@lo:400:kworker.0 00000100:00100000:2.0:1788752908.593152:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752908.593190:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752908.593225:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752908.593244:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164800896 00000100:00100000:3.0:1788752908.593256:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164800896 00000100:00100000:1.0:1788752908.593301:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801152 00000100:00100000:1.0:1788752908.593308:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801152 00000100:00100000:3.0:1788752908.593318:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:3.0:1788752908.593331:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164800896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752908.593352:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801024 00000100:00100000:1.0:1788752908.593356:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801024 00000100:00100000:1.0:1788752908.593382:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1788752908.593390:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164801152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752908.593408:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164800896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752908.593417:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:1.0:1788752908.593430:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164801152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 40us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752908.593438:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:3.0:1788752908.593456:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:3.0:1788752908.593466:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164801024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:1.0:1788752908.593475:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752908.593495:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164801024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752908.593503:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000020:00000080:0.0:1788752909.040187:0:11150:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc10e32040 20000000:00000080:0.0:1788752909.040208:0:11150:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c9bbdde9c00 uarg=0000000000000000 20000000:01000000:0.0:1788752909.040245:0:11150:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788752909.040251:0:11150:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788752909.040255:0:11150:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788752909.041569:0:11151:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788752909.042274:0:11150:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788752909.057186:0:11150:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788752909.057253:0:11150:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057277:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057287:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057305:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057313:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057320:0:11150:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057328:0:11150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057371:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057385:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 12 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752909.057399:0:11150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659072:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752909.057500:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057509:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 18 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752909.057517:0:11150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659200:0@lo:104: 00000100:00100000:1.0:1788752909.057555:0:11150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752909.057602:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057617:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 18 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752909.057625:0:11150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659328:0@lo:104: 00000100:00100000:1.0:1788752909.057658:0:11150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752909.057687:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182659200 00000100:00100000:1.0:1788752909.057694:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182659200 00000100:00100000:3.0:1788752909.057709:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182659328 00000100:00100000:3.0:1788752909.057713:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182659328 00000100:00100000:1.0:1788752909.057742:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788752909.057750:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+4:11150:x1875643182659200:12345-0@lo:104: 00010000:00010000:1.0:1788752909.057772:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057815:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788752909.057821:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+4:11150:x1875643182659200:12345-0@lo:104: Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752909.057828:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788752909.057844:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788752909.057850:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11150:x1875643182659328:12345-0@lo:104: 00010000:00010000:1.0:1788752909.057857:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.057887:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788752909.057891:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11150:x1875643182659328:12345-0@lo:104: Request processed in 42us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752909.057897:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788752909.062169:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788752909.062185:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062206:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788752909.062210:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062219:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788752909.062225:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752909.062231:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788752909.062276:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062283:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788752909.062304:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062311:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8600/0x80c8383f4848fe38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe3f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062323:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752909.062326:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062331:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788752909.062334:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062349:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788752909.062355:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752909.062360:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788752909.062373:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062380:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788752909.062386:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062392:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b85928e00/0x80c8383f4848fe2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe31 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062401:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752909.062402:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752909.062404:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752909.062583:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182659584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752909.062761:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752909.062807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788752909.062814:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182659456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752909.062835:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752909.062876:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062888:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 18 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752909.062904:0:11150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659712:0@lo:104: 00000100:00100000:1.0:1788752909.062927:0:11150:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752909.062953:0:11150:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752909.062974:0:11150:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 12 pid: 5826 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752909.062985:0:11150:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659840:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752909.063026:0:11150:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb2569d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788752909.063048:0:11150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659200:0@lo:104: 00000100:00100000:1.0:1788752909.063058:0:11150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659328:0@lo:104: 00000100:00100000:2.0:1788752909.063157:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182659712 00000100:00100000:2.0:1788752909.063164:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182659712 00000100:00100000:2.0:1788752909.063208:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788752909.063218:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11150:x1875643182659712:12345-0@lo:104: 00010000:00010000:2.0:1788752909.063228:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752909.063277:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788752909.063283:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11150:x1875643182659712:12345-0@lo:104: Request processed in 67us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752909.063290:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788752909.063312:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788752909.063316:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752909.063322:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788752909.063325:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752909.063332:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788752909.063346:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752909.063351:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788752909.063378:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752909.063384:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788752909.063401:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752909.063407:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe23 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752909.063419:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182659584 00010000:00010000:2.0:1788752909.063421:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752909.063423:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752909.063424:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182659584 00010000:00010000:2.0:1788752909.063425:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752909.063442:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 19 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752909.063462:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182659456 00000100:00100000:3.0:1788752909.063466:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182659456 00010000:00010000:3.0:1788752909.063483:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 20 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752909.063496:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788752909.063502:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+20:3306:x1875643182659584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788752909.063512:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752909.063517:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 20 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752909.063517:0:11150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659712:0@lo:104: 00000100:00100000:1.0:1788752909.064189:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182659968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752909.064226:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752909.064261:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752909.064270:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788752909.064276:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788752909.064414:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752909.064445:0:11150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659072:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752909.065478:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 20 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.065494:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928600/0x80c8383f4848fe31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fe2a expref: 20 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.065507:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752909.065621:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182659584:12345-0@lo:103:ldlm_bl.0 Request processed in 2118us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752909.065629:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788752909.065677:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182659968 00000100:00100000:3.0:1788752909.065684:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182659968 00010000:00010000:3.0:1788752909.065715:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 19 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752909.065729:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801280 00000100:00100000:3.0:1788752909.065732:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801280 00010000:00010000:3.0:1788752909.065745:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 13 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752909.065759:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788752909.065766:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182659456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788752909.065792:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752909.065799:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 19 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.065806:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 19 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.065816:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2d200/0x80c8383f4848fe3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fe38 expref: 19 pid: 5826 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.065824:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752909.065849:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3306:x1875643182659456:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (3013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752909.065857:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788752909.065860:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788752909.065874:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788752909.065882:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:3303:x1875643182659968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788752909.065891:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752909.065897:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 17 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.065907:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 17 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.065918:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f4848fe23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fe1c expref: 17 pid: 5827 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.065929:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752909.065977:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3303:x1875643182659968:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752909.065991:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182659968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752909.066228:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182659584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752909.066244:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182659456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788752909.066314:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:0.0:1788752909.066326:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788752909.066327:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164801280:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752909.066338:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752909.066344:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 13 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.066356:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 13 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.066367:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eec6 expref: 13 pid: 5825 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752909.066376:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752909.066420:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:2360:x1875643164801280:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 98us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752909.066436:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:2.0:1788752909.075936:0:11150:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11150:1875643182659840:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752909.075936:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:2.0:1788752909.075991:0:11150:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752909.076793:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801408 00000100:00100000:0.0:1788752909.076804:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801408 00010000:00010000:0.0:1788752909.076860:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 12 pid: 5826 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752909.076904:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:0.0:1788752909.076914:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:2361:x1875643164801408:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752909.076930:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752909.076936:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 12 pid: 5826 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.076947:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 12 pid: 5826 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.076976:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2ce00/0x80c8383f4848fe15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee8e expref: 12 pid: 5826 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.076994:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077002:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077018:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077025:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077032:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077039:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077051:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752909.077055:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077063:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077083:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752909.077093:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752909.077172:0:11150:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752909.077183:0:11150:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752909.077185:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:2361:x1875643164801408:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 270us (1261us total) trans 0 rc 0/0 00010000:00010000:2.0:1788752909.077200:0:11150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bbe270800/0x80c8383f4848fe70 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752909.077203:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00010000:00010000:3.0:1788752909.230726:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752910.251383:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752910.390609:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752910.393263:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801536 00000100:00100000:2.0:1788752910.393278:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801536 00000100:00100000:2.0:1788752910.393339:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:2.0:1788752910.393349:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:5598:x1875643164801536:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788752910.393366:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752910.393385:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852eef0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752910.393414:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752910.393426:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752910.393434:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928000, rc 0) 00000100:00100000:2.0:1788752910.393504:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164801536:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 156us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752910.393511:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:0.0:1788752910.397349:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752910.397432:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801664 00000100:00100000:2.0:1788752910.397441:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801664 00000100:00100000:2.0:1788752910.397494:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00100000:2.0:1788752910.397504:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164801664:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752910.399095:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164801664:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 1584us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752910.399107:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00100000:0.0:1788752910.411785:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752910.411827:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801792 00000100:00100000:0.0:1788752910.411837:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801792 00000100:00100000:0.0:1788752910.411881:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 227 00000100:00100000:0.0:1788752910.411890:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164801792:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.412149:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164801792:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 232us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.412158:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 227 00000100:00100000:3.0:1788752910.428331:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752910.428552:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164801920 00000100:00100000:2.0:1788752910.428561:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164801920 00000100:00100000:2.0:1788752910.428603:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:2.0:1788752910.428611:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164801920:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788752910.428628:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752910.428644:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852eef7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752910.428671:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752910.428683:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752910.428692:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929c00, rc 0) 00000100:00100000:2.0:1788752910.429058:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164801920:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 445us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752910.429065:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:0.0:1788752910.437165:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752910.437249:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164802048 00000100:00100000:2.0:1788752910.437261:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164802048 00000100:00100000:2.0:1788752910.437315:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:2.0:1788752910.437325:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164802048:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752910.437611:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164802048:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 287us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752910.437618:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:0.0:1788752910.464432:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752910.468433:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164802176 00000100:00100000:3.0:1788752910.468448:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164802176 00000100:00100000:3.0:1788752910.468518:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:3.0:1788752910.468529:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164802176:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752910.468770:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164802176:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 243us (4349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752910.468779:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 230 10000000:01000000:1.0:1788752910.643214:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788752910.643223:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bafe44000 from 7 10000000:01000000:1.0:1788752910.643228:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788752910.643280:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752910.643291:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752910.643300:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752910.643323:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788752910.643385:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752910.643435:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.646091:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660096 00000100:00100000:0.0:1788752910.646108:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660096 00000100:00100000:0.0:1788752910.646187:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788752910.646196:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182660096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752910.646211:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752910.646227:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fe85 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.646263:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.646273:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.646281:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752910.646351:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182660096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.646357:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788752910.646537:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788752910.646555:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752910.646564:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752910.647495:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752910.647544:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752910.647578:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788752910.647925:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660224 00000100:00100000:2.0:1788752910.647933:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660224 00000100:00100000:2.0:1788752910.647984:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788752910.648004:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182660224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752910.648298:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182660224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752910.648305:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788752910.648492:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752910.648530:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788752910.648571:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752910.649863:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.651881:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660352 00000100:00100000:0.0:1788752910.651897:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660352 00000100:00100000:0.0:1788752910.652004:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788752910.652015:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182660352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.652894:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182660352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 877us (4318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.652903:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788752910.653032:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788752910.670292:0:11194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788752910.670359:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788752910.670378:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788752910.670388:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.670414:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752910.670424:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788752910.670426:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbd907800 from 7 10000000:01000000:0.0:1788752910.670429:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788752910.670462:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.670470:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.670481:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752910.670504:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.670573:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752910.670623:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.670644:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660480 00000100:00100000:0.0:1788752910.670651:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660480 00000100:00100000:0.0:1788752910.670693:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788752910.670702:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182660480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752910.670718:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752910.670731:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fe93 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.670756:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.670780:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.670790:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8600, rc 0) 00000100:00100000:0.0:1788752910.670828:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182660480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.670835:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788752910.670887:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752910.670902:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.670911:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752910.670970:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.670994:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752910.671007:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.671019:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660608 00000100:00100000:0.0:1788752910.671022:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660608 00000100:00100000:0.0:1788752910.671045:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788752910.671051:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182660608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.671309:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182660608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.671316:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788752910.671344:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.671379:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.671415:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752910.671429:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.671440:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660736 00000100:00100000:0.0:1788752910.671443:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660736 00000100:00100000:0.0:1788752910.671462:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788752910.671467:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182660736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.671614:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182660736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.671620:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788752910.671662:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788752910.678394:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788752910.679699:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788752910.679743:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788752910.679753:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752910.679765:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752910.679775:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788752910.679778:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9b90a5a800 from 7 10000000:01000000:1.0:1788752910.679780:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788752910.679815:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752910.679821:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752910.679831:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752910.679854:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788752910.679917:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752910.679966:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc000 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.680299:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660864 00000100:00100000:0.0:1788752910.680306:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660864 00000100:00100000:0.0:1788752910.680355:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788752910.680365:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182660864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752910.680379:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752910.680392:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fea1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.680417:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.680427:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.680435:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9000, rc 0) 00000100:00100000:0.0:1788752910.680489:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182660864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.680495:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788752910.680550:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752910.680563:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752910.680572:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752910.680860:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.680889:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752910.680904:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.680919:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182660992 00000100:00100000:0.0:1788752910.680923:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182660992 00000100:00100000:0.0:1788752910.680944:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788752910.680949:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182660992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.681211:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182660992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.681218:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788752910.681253:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182660992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.681337:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182661120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.681374:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752910.681388:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b875a7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788752910.681399:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182661120 00000100:00100000:0.0:1788752910.681403:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182661120 00000100:00100000:0.0:1788752910.681431:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788752910.681436:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182661120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752910.682224:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182661120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 783us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752910.682234:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788752910.682367:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182661120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788752910.688463:0:11199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788752910.688614:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788752910.688635:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788752910.688647:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752910.688675:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752911.275645:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752912.298347:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752912.555655:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182661248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752912.555736:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752912.555809:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182661248 00000100:00100000:3.0:1788752912.555818:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182661248 00000100:00100000:3.0:1788752912.555873:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788752912.555882:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182661248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752912.555915:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752912.555969:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182661248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752912.555976:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788752912.556018:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef30380 x1875643182661248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752912.556052:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182661248:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788752912.560635:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788752913.290275:0:11351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788752913.322362:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752913.578469:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182661632:0@lo:400:kworker.0 00000100:00100000:3.0:1788752913.579067:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752913.579624:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788752913.579635:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182661760:0@lo:400:kworker.0 00000100:00100000:3.0:1788752913.579676:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752913.579721:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182661632 00000100:00100000:3.0:1788752913.579729:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182661632 00000100:00100000:3.0:1788752913.579788:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788752913.579798:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182661632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752913.579852:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182661632:12345-0@lo:400:kworker.0 Request processed in 56us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752913.579859:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788752913.579901:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182661760 00000100:00100000:3.0:1788752913.579905:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182661760 00000100:00100000:3.0:1788752913.579941:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788752913.579949:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182661760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752913.579995:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182661760:12345-0@lo:400:kworker.0 Request processed in 47us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752913.580002:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788752913.580007:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182661504:0@lo:400:kworker.0 00000100:00080000:3.0:1788752913.580023:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752913.580044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788752913.580063:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef33100 x1875643182661760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752913.580073:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182662016:0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580097:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752913.580102:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182661760:0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580156:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788752913.580158:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182661632:0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580165:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182661376:0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580197:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752913.580218:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182661888:0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580236:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752913.580259:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182661504 00000100:00100000:0.0:1788752913.580263:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182661504 00000100:00100000:0.0:1788752913.580287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182661888 00000100:00100000:0.0:1788752913.580290:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182661888 00000100:00100000:0.0:1788752913.580310:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788752913.580316:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182661504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580351:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182661504:12345-0@lo:400:kworker.0 Request processed in 34us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752913.580357:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788752913.580372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788752913.580378:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182661888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580414:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182661888:12345-0@lo:400:kworker.0 Request processed in 36us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752913.580420:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788752913.580440:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182661376 00000100:00100000:0.0:1788752913.580444:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182661376 00000100:00100000:0.0:1788752913.580464:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788752913.580470:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182661376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580497:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182661376:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752913.580503:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788752913.580549:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182661376:0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580559:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182661888:0@lo:400:kworker.0 00000100:00100000:0.0:1788752913.580568:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182661504:0@lo:400:kworker.0 00000100:00100000:2.0:1788752913.581201:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662016 00000100:00100000:2.0:1788752913.581208:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662016 00000100:00100000:2.0:1788752913.581256:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788752913.581265:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182662016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752913.581319:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182662016:12345-0@lo:400:kworker.0 Request processed in 56us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752913.581325:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788752913.581360:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef31c00 x1875643182662016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752913.581374:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182662016:0@lo:400:kworker.0 00000100:00080000:3.0:1788752913.581486:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788752913.581491:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752913.581802:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788752913.581814:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182662144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752913.581852:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752913.581929:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662144 00000100:00100000:1.0:1788752913.581944:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662144 00000100:00100000:1.0:1788752913.581983:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788752913.581991:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182662144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788752913.582021:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752913.582112:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182662144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752913.582119:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788752913.589232:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bb54b0a80 x1875643182662144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752929 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752913.589266:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182662144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752913.715286:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752913.715332:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752913.715374:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752913.715412:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164802432 00000100:00100000:1.0:1788752913.715413:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164802304 00000100:00100000:1.0:1788752913.715423:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164802304 00000100:00100000:3.0:1788752913.715424:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164802432 00000100:00100000:3.0:1788752913.715480:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164802560 00000100:00100000:3.0:1788752913.715484:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164802560 00000100:00100000:1.0:1788752913.715487:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 241 00000100:00100000:1.0:1788752913.715502:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164802304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752913.715513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1788752913.715521:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164802432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752913.715575:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164802304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 77us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752913.715584:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 241 00000100:00100000:2.0:1788752913.715637:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00080000:1.0:1788752913.715637:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752913.715650:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164802560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752913.715909:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164802432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 388us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752913.715917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:2.0:1788752913.718496:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164802560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 2835us (3107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752913.718513:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00010000:00010000:3.0:1788752914.349184:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752915.370976:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752916.394632:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788752916.680673:0:11451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:48:35 (1788752915) === 00000100:00100000:3.0:1788752916.925507:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752916.925550:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752916.925600:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164802688 00000100:00100000:1.0:1788752916.925610:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164802688 00000100:00100000:1.0:1788752916.925687:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:1.0:1788752916.925698:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164802688:12345-192.168.203.5@tcp:41:mkdir.0 00000004:00000024:1.0:1788752916.925740:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788752916.925849:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164802688:12345-192.168.203.5@tcp:41:mkdir.0 Request processed in 153us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752916.925857:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:1.0:1788752916.925887:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164802816 00000100:00100000:1.0:1788752916.925891:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164802816 00000100:00100000:1.0:1788752916.925924:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1788752916.925932:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:240b527c-392e-42d3-b78c-b594aea00353+6:9679:x1875643164802816:12345-192.168.203.5@tcp:700:mkdir.0 00000100:00100000:1.0:1788752916.925965:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:240b527c-392e-42d3-b78c-b594aea00353+6:9679:x1875643164802816:12345-192.168.203.5@tcp:700:mkdir.0 Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752916.925972:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00080000:3.0:1788752916.928725:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752916.940107:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752916.940209:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164803072 00000100:00100000:1.0:1788752916.940219:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164803072 00000100:00100000:1.0:1788752916.940278:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:1.0:1788752916.940287:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:9679:x1875643164803072:12345-192.168.203.5@tcp:36:mkdir.0 00010000:00010000:1.0:1788752916.940354:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752916.940425:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848fd90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee79 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.940458:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426100) 00010000:00010000:1.0:1788752916.940470:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752916.940780:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.940796:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.940814:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.940845:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.940854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.940860:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752916.942049:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788752916.942065:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.942074:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.942081:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.942088:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752916.942092:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.942101:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.942114:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667500) 00010000:00010000:1.0:1788752916.942118:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752916.942160:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.942167:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848feaf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788752916.942188:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f54e51c7 reply state 00000000df5f59ee transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752916.942198:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788752916.942313:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+7:9679:x1875643164803072:12345-192.168.203.5@tcp:36:mkdir.0 Request processed in 2024us (2215us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788752916.942323:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00010000:00010000:0.0:1788752916.945464:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752916.945485:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752916.945511:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752916.945518:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752916.945523:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752916.945531:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752916.945551:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c9ba3667900) 00010000:00010000:0.0:1788752916.945554:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752916.945558:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752916.945564:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271000/0x80c8383f4848feb6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752916.962012:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752916.962248:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164803200 00000100:00100000:1.0:1788752916.962258:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164803200 00000100:00100000:1.0:1788752916.962370:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:1.0:1788752916.962381:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+6:9681:x1875643164803200:12345-192.168.203.5@tcp:101:chmod.0 00010000:00010000:1.0:1788752916.962404:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752916.962426:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848febd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852eefe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.962518:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848fec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.962539:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848fec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.962558:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848fec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752916.962597:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788752916.962615:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752916.962666:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848fec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.962695:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848febd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eefe expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.962714:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848fec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eefe expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.962722:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667500) 00010000:00010000:1.0:1788752916.962724:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788752916.962728:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270a00, rc 0) 00000100:00100000:1.0:1788752916.962843:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+7:9681:x1875643164803200:12345-192.168.203.5@tcp:101:chmod.0 Request processed in 463us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752916.962851:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1788752916.977534:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752916.977825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164803456 00000100:00100000:1.0:1788752916.977836:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164803456 00000100:00100000:1.0:1788752916.977956:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:1.0:1788752916.977967:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+7:9681:x1875643164803456:12345-192.168.203.5@tcp:36:chmod.0 00010000:00010000:1.0:1788752916.978025:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752916.978053:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848fec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eefe expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.978075:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667500) 00010000:00010000:1.0:1788752916.978085:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752916.978111:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.978182:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.978193:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788752916.979171:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000035e2bf33 reply state 00000000a7233060 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752916.979186:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788752916.979196:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788752916.979289:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+8:9681:x1875643164803456:12345-192.168.203.5@tcp:36:chmod.0 Request processed in 1322us (1764us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788752916.979298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00010000:00010000:1.0:1788752916.986778:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.986798:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.986807:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.986814:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752916.986818:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.986826:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.986844:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667600) 00010000:00010000:1.0:1788752916.986860:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788752916.986866:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752916.986873:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fecb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752917.013686:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752917.013900:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164803584 00000100:00100000:0.0:1788752917.013919:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164803584 00000100:00100000:0.0:1788752917.013980:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:0.0:1788752917.013991:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+7:9682:x1875643164803584:12345-192.168.203.5@tcp:101:chown.0 00010000:00010000:0.0:1788752917.014018:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752917.014042:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848fed2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef05 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.014111:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4848fed9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.014234:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4848fed9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.014247:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4848fed9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752917.017262:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788752917.017274:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752917.017547:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4848fed9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.017597:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848fed2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef05 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.017638:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4848fed9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef05 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.017646:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b9424b000) 00010000:00010000:2.0:1788752917.017649:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752917.017653:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:2.0:1788752917.017731:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+8:9682:x1875643164803584:12345-192.168.203.5@tcp:101:chown.0 Request processed in 3741us (4055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752917.017741:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1788752917.023050:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752917.025701:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164803712 00000100:00100000:2.0:1788752917.025719:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164803712 00000100:00100000:2.0:1788752917.026448:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:2.0:1788752917.026462:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+8:9682:x1875643164803712:12345-192.168.203.5@tcp:101:chown.0 00010000:00010000:2.0:1788752917.026548:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752917.026570:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4848fee0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef0c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026637:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026651:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026662:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026677:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026700:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026707:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026800:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4848fef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026809:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4848fef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026816:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4848fef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752917.026848:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788752917.026852:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752917.026869:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4848fef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026881:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026888:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026894:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026900:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752917.026904:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026928:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026940:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b9424b000) 00010000:00010000:2.0:1788752917.026943:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752917.026948:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026954:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f4848fee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026965:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026971:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026976:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026982:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752917.026984:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026990:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.026996:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c9b89426500) 00010000:00010000:2.0:1788752917.026998:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752917.027000:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.027014:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928600/0x80c8383f4848feee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.027043:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4848fee0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef0c expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.027055:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4848fef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef0c expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.027063:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b89426c00) 00010000:00010000:2.0:1788752917.027066:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752917.027068:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929a00, rc 0) 00000100:00100000:2.0:1788752917.027230:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+9:9682:x1875643164803712:12345-192.168.203.5@tcp:101:chown.0 Request processed in 772us (4193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752917.027237:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1788752917.036024:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752917.036583:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164803968 00000100:00100000:1.0:1788752917.036595:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164803968 00000100:00100000:1.0:1788752917.036659:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:1.0:1788752917.036670:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+9:9682:x1875643164803968:12345-192.168.203.5@tcp:36:chown.0 00010000:00010000:1.0:1788752917.036727:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752917.036753:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4848fef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef0c expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.036775:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b89426c00) 00010000:00010000:1.0:1788752917.036786:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752917.036812:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.036827:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.036837:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788752917.130169:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788752917.130306:0:5834:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000062bb57a8 reply state 0000000081d98330 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752917.130321:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788752917.130337:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788752917.130467:0:5834:0:(ldlm_lib.c:3495:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788752917.131146:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+7:9682:x1875643164803968:12345-192.168.203.5@tcp:36:chown.0 Request processed in 94446us (95101us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788752917.131156:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00010000:00010000:0.0:1788752917.131292:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.131302:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.131311:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.131317:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752917.131322:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.131329:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.131344:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9ba3667600) 00010000:00010000:0.0:1788752917.131347:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788752917.131351:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.131358:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270200/0x80c8383f4848fefc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752917.157592:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752917.157997:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164804096 00000100:00100000:1.0:1788752917.158009:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164804096 00000100:00100000:1.0:1788752917.158079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:1.0:1788752917.158092:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+6:9683:x1875643164804096:12345-192.168.203.5@tcp:101:touch.500 00010000:00010000:1.0:1788752917.158119:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752917.158189:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848ff03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef13 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788752917.162298:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4043us 00010000:00010000:0.0:1788752917.205500:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.205529:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.206663:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.206698:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.206709:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.206719:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.207840:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4848ff18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.207854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4848ff18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.207865:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4848ff18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752917.207894:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788752917.207898:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752917.207948:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4848ff18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.207961:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.207980:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.207987:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.207994:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752917.207999:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208006:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208018:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b9424b000) 00010000:00010000:0.0:1788752917.208021:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752917.208027:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208032:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208043:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208049:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208054:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208058:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752917.208067:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208073:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208082:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752917.208085:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752917.208088:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.208094:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ff11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.209229:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4848ff03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef13 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.209258:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4848ff18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef13 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.209267:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:0.0:1788752917.209269:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788752917.209272:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8a00, rc 0) 00000100:00100000:0.0:1788752917.209349:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+7:9683:x1875643164804096:12345-192.168.203.5@tcp:101:touch.500 Request processed in 51258us (51767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752917.209357:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1788752917.219672:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752917.219959:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164804352 00000100:00100000:3.0:1788752917.219983:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164804352 00000100:00100000:3.0:1788752917.220044:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:3.0:1788752917.220054:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+7:9683:x1875643164804352:12345-192.168.203.5@tcp:101:touch.500 00010000:00010000:3.0:1788752917.220073:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752917.220095:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2c200/0x80c8383f4848ff1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.220360:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.220375:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.220387:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.220400:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.220407:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.220413:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788752917.221109:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788752917.221382:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ff34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221396:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221416:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ff34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221452:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221459:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221466:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221471:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752917.221475:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221482:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221493:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:3.0:1788752917.221497:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752917.221501:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221507:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ff26 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788752917.221520:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005219ea2a reply state 00000000a0be33b3 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752917.221528:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788752917.221566:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2c200/0x80c8383f4848ff1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef1a expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221580:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ff34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef1a expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.221588:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9ba049d400) 00010000:00010000:3.0:1788752917.221590:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752917.221592:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d600, rc 0) 00000100:00100000:3.0:1788752917.221659:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+10:9683:x1875643164804352:12345-192.168.203.5@tcp:101:touch.500 Request processed in 1606us (2194us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788752917.221667:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00010000:00010000:1.0:1788752917.232403:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.232424:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.232432:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.232438:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2de00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752917.232442:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.232450:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.232468:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9c9ba049db00) 00010000:00010000:1.0:1788752917.232647:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752917.232654:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.232660:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ff2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752917.234327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752917.234404:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164804608 00000100:00100000:2.0:1788752917.234414:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164804608 00000100:00100000:2.0:1788752917.234481:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:2.0:1788752917.234493:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+9:9683:x1875643164804608:12345-192.168.203.5@tcp:36:touch.500 00010000:00010000:2.0:1788752917.234561:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752917.234589:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ff34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef1a expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.234609:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9ba049d400) 00010000:00010000:2.0:1788752917.234620:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752917.234678:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.234693:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.234702:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788752917.234841:0:7899:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000005de1487a reply state 0000000091770aa2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752917.234851:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752917.234956:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+10:9683:x1875643164804608:12345-192.168.203.5@tcp:36:touch.500 Request processed in 464us (638us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788752917.234964:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00010000:00010000:0.0:1788752917.238736:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.238775:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.238783:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.238789:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85929600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752917.238795:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.238803:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.238819:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9b89426b00) 00010000:00010000:0.0:1788752917.238822:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752917.238827:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.238834:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752917.239526:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752917.239729:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164804736 00000100:00100000:3.0:1788752917.239740:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164804736 00000100:00100000:3.0:1788752917.239823:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:3.0:1788752917.239835:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+9:9683:x1875643164804736:12345-192.168.203.5@tcp:101:touch.500 00010000:00010000:3.0:1788752917.239861:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752917.239881:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2c200/0x80c8383f4848ff49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef21 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.239957:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2c200/0x80c8383f4848ff49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef21 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.239970:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2c200/0x80c8383f4848ff49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef21 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.239991:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9ba049df00) 00010000:00010000:3.0:1788752917.239994:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752917.240007:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2c200, rc 0) 00000100:00100000:3.0:1788752917.240063:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+10:9683:x1875643164804736:12345-192.168.203.5@tcp:101:touch.500 Request processed in 230us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752917.240070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:2.0:1788752917.247444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752917.247586:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164804864 00000100:00100000:3.0:1788752917.247598:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164804864 00000100:00100000:3.0:1788752917.247644:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1788752917.247651:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875643164804864:12345-192.168.203.5@tcp:8:touch.500 00010000:00080000:3.0:1788752917.247683:0:6691:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:3.0:1788752917.247718:0:6691:0:(genops.c:1384:class_connect()) connect: client 240b527c-392e-42d3-b78c-b594aea00353, cookie 0x80c8383f4848ff50 00002000:00100000:3.0:1788752917.247730:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 240b527c-392e-42d3-b78c-b594aea00353/ffff9c9bb5b9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788752917.247752:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788752917.248016:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788752917.248045:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5b99000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788752917.248223:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2357:x1875643164804864:12345-192.168.203.5@tcp:8:touch.500 Request processed in 570us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752917.248231:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:2.0:1788752917.254890:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752917.254980:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164804992 00000100:00100000:0.0:1788752917.254990:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164804992 00000100:00100000:0.0:1788752917.255058:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:0.0:1788752917.255069:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+6:0:x1875643164804992:12345-192.168.203.5@tcp:2:touch.500 00000100:00080000:3.0:1788752917.255240:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788752917.289498:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1788752917.289519:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000100:00100000:2.0:1788752917.289816:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+5:0:x1875643164804992:12345-192.168.203.5@tcp:2:touch.500 Request processed in 34743us (34930us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788752917.289826:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:0.0:1788752917.299953:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752917.300211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164805248 00000100:00100000:3.0:1788752917.300222:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164805248 00000100:00100000:2.0:1788752917.301508:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:2.0:1788752917.301521:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+10:9683:x1875643164805248:12345-192.168.203.5@tcp:35:touch.500 00000100:00100000:2.0:1788752917.302478:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+11:9683:x1875643164805248:12345-192.168.203.5@tcp:35:touch.500 Request processed in 953us (2530us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788752917.302488:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1788752917.333247:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752917.336826:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164805376 00000100:00100000:2.0:1788752917.336844:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164805376 00000100:00100000:2.0:1788752917.336993:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:2.0:1788752917.337020:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+11:9684:x1875643164805376:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:2.0:1788752917.337048:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752917.337070:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef28 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.337177:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848ff5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.337192:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.337205:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752917.337244:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788752917.337249:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752917.337298:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848ff5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.337325:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4848ff57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef28 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.337347:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848ff5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef28 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752917.337355:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:2.0:1788752917.337359:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752917.337362:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928800, rc 0) 00000100:00100000:2.0:1788752917.337441:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+12:9684:x1875643164805376:12345-192.168.203.5@tcp:101:rm.0 Request processed in 423us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752917.337458:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:3.0:1788752917.344041:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752917.344362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164805632 00000100:00100000:1.0:1788752917.344372:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164805632 00000100:00100000:1.0:1788752917.344432:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:1.0:1788752917.344442:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+12:9684:x1875643164805632:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1788752917.344462:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752917.344483:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752917.344600:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788752917.344782:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef2f expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.344797:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b9424b000) 00010000:00010000:1.0:1788752917.344800:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752917.344804:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef2f expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.344819:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270400, rc 0) 00000100:00100000:1.0:1788752917.344867:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+13:9684:x1875643164805632:12345-192.168.203.5@tcp:101:rm.0 Request processed in 427us (839us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788752917.344883:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:3.0:1788752917.352022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752917.352112:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164805760 00000100:00100000:1.0:1788752917.352160:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164805760 00000100:00100000:1.0:1788752917.352220:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:1.0:1788752917.352230:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+13:9684:x1875643164805760:12345-192.168.203.5@tcp:37:rm.0 00000100:00100000:0.0:1788752917.357630:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+13:9684:x1875643164805760:12345-192.168.203.5@tcp:37:rm.0 Request processed in 5387us (5606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752917.357662:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:3.0:1788752917.366012:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752917.366462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164806016 00000100:00100000:2.0:1788752917.366473:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164806016 00000100:00100000:2.0:1788752917.366577:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:2.0:1788752917.366589:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f779050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+13:9684:x1875643164806016:12345-192.168.203.5@tcp:35:rm.0 00000100:00100000:2.0:1788752917.366838:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f779050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+14:9684:x1875643164806016:12345-192.168.203.5@tcp:35:rm.0 Request processed in 251us (836us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788752917.366846:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:3.0:1788752917.370250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752917.370389:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164806272 00000100:00100000:0.0:1788752917.370400:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164806272 00000100:00100000:0.0:1788752917.370512:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:0.0:1788752917.370522:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+14:9684:x1875643164806272:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:0.0:1788752917.370547:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752917.370568:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef36 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.370674:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4848ff7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.370691:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4848ff7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.370704:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4848ff7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752917.370716:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788752917.370840:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ff73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef36 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.370860:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4848ff7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef36 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.370869:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:0.0:1788752917.370872:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788752917.370875:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8000, rc 0) 00000100:00100000:0.0:1788752917.370971:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+16:9684:x1875643164806272:12345-192.168.203.5@tcp:101:rm.0 Request processed in 449us (733us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788752917.370978:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:1.0:1788752917.376570:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752917.376667:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164806400 00000100:00100000:3.0:1788752917.376679:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164806400 00000100:00100000:3.0:1788752917.376760:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:3.0:1788752917.376770:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+16:9684:x1875643164806400:12345-192.168.203.5@tcp:41:rm.0 00000004:00000024:3.0:1788752917.376829:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788752917.376924:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+16:9684:x1875643164806400:12345-192.168.203.5@tcp:41:rm.0 Request processed in 154us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752917.376932:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:3.0:1788752917.381337:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752917.382487:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164806528 00000100:00100000:1.0:1788752917.382502:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164806528 00000100:00100000:1.0:1788752917.382558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:1.0:1788752917.382569:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+16:9684:x1875643164806528:12345-192.168.203.5@tcp:101:rm.0 00010000:00010000:1.0:1788752917.382591:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752917.382610:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4848ff88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.382676:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.382933:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.382948:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.382966:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.382974:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383013:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383114:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383158:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383166:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752917.383195:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788752917.383199:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752917.383219:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383233:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383242:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383248:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383255:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383272:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752917.383276:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383291:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383304:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:1.0:1788752917.383306:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752917.383312:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383319:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4848ff8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383333:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383344:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383350:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383355:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752917.383358:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383363:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383371:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9c9ba3667500) 00010000:00010000:1.0:1788752917.383373:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752917.383376:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383392:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4848ff96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383428:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4848ff88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef3d expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383441:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef3d expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.383448:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9ba049df00) 00010000:00010000:1.0:1788752917.383451:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752917.383453:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270400, rc 0) 00000100:00100000:1.0:1788752917.383527:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+17:9684:x1875643164806528:12345-192.168.203.5@tcp:101:rm.0 Request processed in 959us (2203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752917.383535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:2.0:1788752917.389978:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752917.390337:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164806784 00000100:00100000:3.0:1788752917.390348:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164806784 00000100:00100000:3.0:1788752917.390439:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:3.0:1788752917.390450:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+17:9684:x1875643164806784:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:3.0:1788752917.390513:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788752917.390550:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4848ff9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef3d expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390650:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2c200/0x80c8383f4848ff49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef21 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390663:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9ba049df00) 00010000:00010000:3.0:1788752917.390680:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f4848ff5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef28 expref: 15 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390688:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:3.0:1788752917.390690:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752917.390711:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390744:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390754:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390978:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390987:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.390994:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.391156:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.391165:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.391172:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788752917.392840:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788752917.392957:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 317126832678ns, next at 318126828823ns, rc = 0 00010000:00010000:3.0:1788752917.393038:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393053:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393077:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393086:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393093:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393099:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393202:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788752917.393225:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393231:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393238:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393244:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2de00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752917.393248:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393256:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393268:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752917.393270:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788752917.393282:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393288:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2de00/0x80c8383f4848ffb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393307:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393313:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393319:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393324:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752917.393326:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393332:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393339:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:3.0:1788752917.393342:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752917.393345:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752917.393351:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4848ffa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788752917.393360:0:7899:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e9443616 reply state 000000001c267ec3 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752917.393379:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788752917.393517:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+16:9684:x1875643164806784:12345-192.168.203.5@tcp:36:rm.0 Request processed in 3065us (3548us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788752917.393527:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00010000:00010000:1.0:1788752917.393542:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752917.393550:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.393557:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2ce00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752917.393561:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.393568:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.393577:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:1.0:1788752917.393580:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788752917.393591:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.393596:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4848ffb9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.393614:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752917.393616:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752917.393618:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752917.396436:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.396455:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.396463:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.396469:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752917.396473:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.396480:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.396497:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff9c9ba049d000) 00010000:00010000:1.0:1788752917.396510:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752917.396515:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752917.396521:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4848ffab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752917.400960:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752917.401352:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164807040 00000100:00100000:0.0:1788752917.401361:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164807040 00000100:00100000:0.0:1788752917.401410:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:0.0:1788752917.401418:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+15:9684:x1875643164807040:12345-192.168.203.5@tcp:35:rm.0 00000100:00100000:0.0:1788752917.401674:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+16:9684:x1875643164807040:12345-192.168.203.5@tcp:35:rm.0 Request processed in 254us (725us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788752917.401681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1788752917.407069:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752917.409951:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164807296 00000100:00100000:0.0:1788752917.409978:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164807296 00000100:00100000:0.0:1788752917.410061:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1788752917.410073:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+16:9684:x1875643164807296:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:0.0:1788752917.410188:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788752917.410217:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4848ff7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef36 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410243:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4848ff18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef13 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410254:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424b900) 00010000:00010000:0.0:1788752917.410271:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4848fed9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef05 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410279:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b9424b000) 00010000:00010000:0.0:1788752917.410298:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788752917.410324:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410337:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410346:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410360:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410366:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410372:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410615:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410624:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.410631:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752917.411240:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788752917.411256:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411264:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411278:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411284:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752917.411288:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411296:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411309:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752917.411312:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788752917.411317:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411323:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f4848ffce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411343:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411349:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411355:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411360:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752917.411363:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411378:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411386:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752917.411389:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752917.411392:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.411398:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4848ffc0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752917.411411:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a58626bb reply state 000000006671864c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752917.411420:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788752917.411509:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+15:9684:x1875643164807296:12345-192.168.203.5@tcp:36:rm.0 Request processed in 1435us (4450us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788752917.411517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00010000:00010000:2.0:1788752917.418379:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752917.418446:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.418461:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.418468:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.418475:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752917.418480:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.418506:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.418520:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c9b9424b300) 00010000:00010000:0.0:1788752917.418523:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752917.418529:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752917.418535:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4848ffc7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752917.674555:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752917.674587:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182662272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752917.674657:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752917.674785:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662272 00000100:00100000:3.0:1788752917.674792:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662272 00000100:00100000:3.0:1788752917.674858:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788752917.674868:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182662272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752917.674889:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752917.674957:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182662272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752917.674964:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788752917.675000:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88b2dc00 x1875643182662272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752917.675019:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182662272:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788752917.675463:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788752918.442370:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752918.698379:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182662528:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.698452:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752918.698514:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182663040:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.698537:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752918.698567:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788752918.698573:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182662400:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.698596:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752918.698614:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182662912:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.698644:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752918.698671:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182662656:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.698706:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752918.698728:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788752918.698733:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182662784:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.698753:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752918.698785:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662528 00000100:00100000:3.0:1788752918.698793:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662528 00000100:00100000:3.0:1788752918.698836:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662912 00000100:00100000:3.0:1788752918.698839:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662912 00000100:00100000:3.0:1788752918.698861:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662656 00000100:00100000:3.0:1788752918.698864:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662656 00000100:00100000:3.0:1788752918.698880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788752918.698889:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182662528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.698959:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182662528:12345-0@lo:400:kworker.0 Request processed in 71us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.698966:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788752918.698984:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788752918.698991:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182662912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699017:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182662912:12345-0@lo:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.699022:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788752918.699032:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788752918.699037:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182662656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699064:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182662656:12345-0@lo:400:kworker.0 Request processed in 26us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.699070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788752918.699096:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182663040 00000100:00100000:3.0:1788752918.699099:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182663040 00000100:00100000:3.0:1788752918.699152:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662784 00000100:00100000:3.0:1788752918.699155:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662784 00000100:00100000:3.0:1788752918.699176:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788752918.699182:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182663040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699214:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182663040:12345-0@lo:400:kworker.0 Request processed in 32us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.699221:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788752918.699233:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788752918.699239:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182662784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699264:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182662784:12345-0@lo:400:kworker.0 Request processed in 26us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.699270:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788752918.699288:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182662400 00000100:00100000:3.0:1788752918.699292:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182662400 00000100:00100000:3.0:1788752918.699315:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788752918.699323:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182662400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699351:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90825c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182662400:12345-0@lo:400:kworker.0 Request processed in 29us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.699357:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:3.0:1788752918.699393:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788752918.699398:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788752918.699430:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88b2f480 x1875643182662784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752918.699443:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182662784:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699454:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182662656:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699493:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182662400:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699504:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182662912:0@lo:400:kworker.0 00000100:00100000:3.0:1788752918.699513:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182662528:0@lo:400:kworker.0 00010000:00080000:3.0:1788752918.699522:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b88b2f800 x1875643182663040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752918.699530:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182663040:0@lo:400:kworker.0 00000100:00100000:1.0:1788752918.700142:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788752918.700153:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182663168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752918.700190:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752918.700405:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182663168 00000100:00100000:3.0:1788752918.700411:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182663168 00000100:00100000:3.0:1788752918.700449:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788752918.700456:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182663168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788752918.700496:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752918.700548:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182663168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.700554:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788752918.700623:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b9091df80 x1875643182663168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752934 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752918.700641:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182663168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788752918.854734:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752918.854785:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752918.854812:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752918.854837:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752918.854864:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164807680 00000100:00100000:2.0:1788752918.854874:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164807680 00000100:00100000:2.0:1788752918.854938:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:2.0:1788752918.854948:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164807680:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752918.855013:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164807680:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752918.855020:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:2.0:1788752918.855044:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164807552 00000100:00100000:2.0:1788752918.855048:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164807552 00000100:00100000:2.0:1788752918.855079:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164807808 00000100:00100000:2.0:1788752918.855092:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164807808 00000100:00100000:2.0:1788752918.855115:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 89 00000100:00100000:2.0:1788752918.855161:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+14:2361:x1875643164807552:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752918.855194:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+14:2361:x1875643164807552:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 72us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752918.855200:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 89 00000100:00100000:2.0:1788752918.855214:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:2.0:1788752918.855220:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2361:x1875643164807808:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752918.855241:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2361:x1875643164807808:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 22us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752918.855247:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:3.0:1788752918.855705:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164807424 00000100:00100000:3.0:1788752918.855712:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164807424 00000100:00100000:3.0:1788752918.855749:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 243 00000100:00100000:3.0:1788752918.855757:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2361:x1875643164807424:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752918.855788:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2361:x1875643164807424:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 32us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752918.855794:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 243 00000100:00080000:2.0:1788752918.856217:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788752919.466276:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752920.492600:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788752921.463088:0:11601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788752921.516488:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788752922.389752:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788752922.389781:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788752922.390604:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182663296:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788752922.390672:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752922.390754:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182663296 00000100:00100000:3.0:1788752922.390761:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182663296 00000100:00100000:3.0:1788752922.390805:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788752922.390814:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182663296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788752922.390840:0:6690:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788752922.390884:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9e3415, atime: 0x6a9e3415, ctime: 0x6a9e3415, blocks: 0x1 00010000:00010000:3.0:1788752922.390892:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752922.390908:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:3.0:1788752922.390912:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752922.390917:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752922.390932:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752922.390941:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752922.390948:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752922.390967:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788752922.391677:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182663296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 861us (1002us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788752922.391687:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1788752922.391757:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9bb54b0a80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788752922.391763:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182663296:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788752922.391841:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788752922.391908:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752922.391916:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.391926:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752922.391930:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.391938:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.391958:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.391974:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6c5826c/0x80c8383f4848ffd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.391994:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752922.391996:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752922.391997:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752922.544973:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788752922.652858:0:11650:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb5435e60 20000000:00000080:0.0:1788752922.652885:0:11650:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c9a869ab000 uarg=0000000000000000 20000000:01000000:0.0:1788752922.652923:0:11650:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788752922.652929:0:11650:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788752922.652933:0:11650:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788752922.653756:0:11651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788752922.653909:0:11650:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788752922.659419:0:11650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788752922.659495:0:11650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788752922.660024:0:11650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788752922.660056:0:11650:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788752922.660077:0:11650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660098:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660106:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660196:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660203:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660210:0:11650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660217:0:11650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660257:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.660271:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 18 pid: 5826 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.660284:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663424:0@lo:104: 00000100:00100000:0.0:1788752922.660342:0:11650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752922.661710:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182663424 00000100:00100000:1.0:1788752922.661722:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182663424 00010000:00010000:0.0:1788752922.661777:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.661791:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 18 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.661802:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663552:0@lo:104: 00000100:00100000:1.0:1788752922.661806:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788752922.661815:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11650:x1875643182663424:12345-0@lo:104: 00010000:00010000:1.0:1788752922.661827:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.661840:0:11650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752922.661890:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788752922.661897:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11650:x1875643182663424:12345-0@lo:104: Request processed in 83us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752922.661904:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788752922.661945:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788752922.661952:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.661959:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788752922.661964:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.661973:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788752922.661990:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752922.661995:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788752922.662028:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.662034:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788752922.662055:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.662062:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271600/0x80c8383f4848fea1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fea8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.662073:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752922.662074:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752922.662076:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752922.662088:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182663680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788752922.662116:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752922.662170:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182663680 00000100:00100000:2.0:1788752922.662175:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182663680 00010000:00010000:2.0:1788752922.662195:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 19 pid: 5826 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752922.662215:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788752922.662221:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182663680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788752922.662230:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752922.662234:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 19 pid: 5826 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.662249:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 19 pid: 5826 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.662264:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752922.662295:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182663680:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752922.662341:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788752922.662380:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182663680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788752922.662565:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.662581:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 18 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.662591:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663808:0@lo:104: 00000100:00100000:1.0:1788752922.662631:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182663552 00000100:00100000:1.0:1788752922.662636:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182663552 00000100:00100000:1.0:1788752922.662652:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788752922.662659:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11650:x1875643182663552:12345-0@lo:104: 00010000:00010000:1.0:1788752922.662667:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.662684:0:11650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788752922.662699:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788752922.662704:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11650:x1875643182663552:12345-0@lo:104: Request processed in 47us (863us total) trans 0 rc 0/0 00010000:00010000:0.0:1788752922.662707:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.662717:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 12 pid: 5825 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752922.662718:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788752922.662726:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663936:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752922.662736:0:7615:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788752922.662744:0:7615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182663808 00000100:00100000:1.0:1788752922.662747:0:7615:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182663808 00000100:00100000:1.0:1788752922.662759:0:7615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788752922.662764:0:7615:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a84b73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11650:x1875643182663808:12345-0@lo:104: 00010000:00010000:1.0:1788752922.662771:0:7615:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662801:0:7615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788752922.662806:0:7615:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a84b73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+3:11650:x1875643182663808:12345-0@lo:104: Request processed in 42us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752922.662810:0:7615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788752922.662846:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788752922.662851:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662857:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9e00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788752922.662860:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662868:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788752922.662883:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752922.662889:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788752922.662903:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662914:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788752922.662930:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662937:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f4848fe93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe9a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662948:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752922.662951:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662957:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270c00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788752922.662959:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662967:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788752922.662973:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752922.662978:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788752922.662991:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.662996:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788752922.663010:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.663016:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270c00/0x80c8383f4848fe85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f4848fe8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.663034:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752922.663036:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752922.663038:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752922.663044:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752922.663053:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182664192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752922.663078:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752922.663110:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182664192 00000100:00100000:1.0:1788752922.663113:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182664192 00010000:00010000:0.0:1788752922.663118:0:11650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.663146:0:11650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 12 pid: 5826 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.663153:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 19 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.663155:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182664320:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752922.663172:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788752922.663178:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182664192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788752922.663186:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788752922.663189:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee453c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788752922.663190:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 19 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.663198:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 19 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.663203:0:11650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc9000/0x80c8383f4848fea8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fea1 expref: 19 pid: 5826 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752922.663208:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752922.663212:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663424:0@lo:104: 00000100:00100000:0.0:1788752922.663219:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663552:0@lo:104: 00010000:00010000:0.0:1788752922.663227:0:11650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc9c00/0x80c8383f4848fe8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fe85 expref: 18 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752922.663231:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3303:x1875643182664192:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752922.663237:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788752922.663245:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663808:0@lo:104: 00000100:00100000:1.0:1788752922.663257:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182664064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752922.663281:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752922.663323:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182664192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788752922.663498:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182664064 00000100:00100000:0.0:1788752922.663663:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182664064 00010000:00010000:0.0:1788752922.663682:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 17 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.663704:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788752922.663710:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577cb32-91f9-472d-9b00-c1edbc016b63+17:3306:x1875643182664064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788752922.663718:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752922.663722:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 17 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.663731:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 17 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.663741:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fe9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f4848fe93 expref: 17 pid: 5825 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.663749:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752922.663784:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3306:x1875643182664064:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752922.663790:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788752922.664189:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182664064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788752922.666834:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182663936:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752922.666851:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11650:1875643182664320:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752922.666891:0:11650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.668267:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752922.668324:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752922.668545:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164807936 00000100:00100000:2.0:1788752922.668553:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164807936 00010000:00010000:2.0:1788752922.668595:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 13 pid: 5826 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752922.668620:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808064 00000100:00100000:2.0:1788752922.668623:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808064 00010000:00010000:2.0:1788752922.668633:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 14 pid: 5825 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752922.668658:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:2.0:1788752922.668667:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+14:2361:x1875643164807936:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752922.668682:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752922.668687:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 14 pid: 5826 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668697:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 14 pid: 5826 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668713:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928000/0x80c8383f4848fe77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef0 expref: 14 pid: 5826 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668738:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752922.668787:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2361:x1875643164807936:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 120us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752922.668794:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:2.0:1788752922.668813:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:2.0:1788752922.668819:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:2361:x1875643164808064:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752922.668827:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752922.668832:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 12 pid: 5825 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668841:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 12 pid: 5825 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668850:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85929c00/0x80c8383f4848fe7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852eef7 expref: 12 pid: 5825 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668860:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668869:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668892:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668899:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668915:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668922:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668929:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788752922.668933:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668941:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668952:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752922.668962:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752922.668981:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:2361:x1875643164808064:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 162us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752922.668987:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00010000:00010000:0.0:1788752922.669300:0:11650:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.669306:0:11650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752922.669310:0:11650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8400/0x80c8383f4848ffdc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752922.794626:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788752922.794651:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182664448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752922.794727:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752922.796460:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182664448 00000100:00100000:3.0:1788752922.796475:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182664448 00000100:00100000:3.0:1788752922.796547:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788752922.796557:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182664448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752922.796597:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752922.796683:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182664448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752922.796690:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788752922.797077:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182664448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788752923.562355:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752923.699315:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752923.708286:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808192 00000100:00100000:3.0:1788752923.708307:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808192 00000100:00100000:3.0:1788752923.708404:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 244 00000100:00100000:3.0:1788752923.708417:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:5598:x1875643164808192:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752923.708436:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752923.708458:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848ffe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef44 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.708491:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848ffe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef44 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.708503:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848ffe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef44 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.708513:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2de00, rc 0) 00000100:00100000:3.0:1788752923.708587:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164808192:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 172us (9284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752923.708611:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 244 00000100:00100000:3.0:1788752923.716973:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752923.717942:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808320 00000100:00100000:0.0:1788752923.717958:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808320 00000100:00100000:0.0:1788752923.718023:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:0.0:1788752923.718034:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164808320:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.719691:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164808320:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 1647us (2719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.719705:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 245 00000100:00100000:0.0:1788752923.723574:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752923.729478:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808448 00000100:00100000:1.0:1788752923.729496:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808448 00000100:00100000:1.0:1788752923.729571:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 246 00000100:00100000:1.0:1788752923.729582:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164808448:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788752923.729855:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90811c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164808448:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 274us (6292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.729863:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 246 00000100:00100000:2.0:1788752923.746294:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752923.749328:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808576 00000100:00100000:0.0:1788752923.749347:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808576 00000100:00100000:0.0:1788752923.749434:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:0.0:1788752923.749445:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:9954:x1875643164808576:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788752923.749745:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:9954:x1875643164808576:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 301us (3462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.749766:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 247 00000100:00100000:2.0:1788752923.754184:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752923.754267:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808704 00000100:00100000:3.0:1788752923.754279:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808704 00000100:00100000:3.0:1788752923.754339:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 248 00000100:00100000:3.0:1788752923.754350:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:9954:x1875643164808704:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788752923.754626:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:9954:x1875643164808704:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 275us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752923.754634:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 248 00000100:00100000:3.0:1788752923.760465:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752923.760646:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808832 00000100:00100000:1.0:1788752923.760658:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808832 00000100:00100000:1.0:1788752923.760724:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:1.0:1788752923.760735:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:5598:x1875643164808832:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788752923.760765:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752923.760785:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe271c00/0x80c8383f4848ffea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef4b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.760824:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe271c00/0x80c8383f4848ffea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef4b expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.760837:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe271c00/0x80c8383f4848ffea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef4b expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.760847:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271c00, rc 0) 00000100:00100000:1.0:1788752923.760923:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164808832:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 189us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.760931:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 249 00000100:00100000:2.0:1788752923.769073:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752923.769169:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164808960 00000100:00100000:0.0:1788752923.769181:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164808960 00000100:00100000:0.0:1788752923.769244:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 250 00000100:00100000:0.0:1788752923.769255:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164808960:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.769989:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164808960:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 731us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.769998:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 250 00000100:00100000:2.0:1788752923.798386:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752923.798485:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809088 00000100:00100000:3.0:1788752923.798511:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809088 00000100:00100000:3.0:1788752923.798577:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 251 00000100:00100000:3.0:1788752923.798589:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164809088:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752923.798830:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90813c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:5598:x1875643164809088:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 242us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752923.798838:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 251 00000100:00100000:2.0:1788752923.812196:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752923.812460:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809216 00000100:00100000:0.0:1788752923.812470:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809216 00000100:00100000:0.0:1788752923.812527:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 252 00000100:00100000:0.0:1788752923.812537:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:9957:x1875643164809216:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788752923.813213:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:9957:x1875643164809216:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 674us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.813222:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 252 00000100:00100000:1.0:1788752923.818396:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182664704:0@lo:400:kworker.0 00000100:00100000:2.0:1788752923.818445:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182664576:0@lo:400:kworker.0 00000100:00100000:1.0:1788752923.818477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.818595:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182664960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752923.818678:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182664704 00000100:00100000:1.0:1788752923.818686:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182664704 00000100:00100000:1.0:1788752923.818736:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788752923.818745:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182664704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752923.822785:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182664832:0@lo:400:kworker.0 00000100:00100000:2.0:1788752923.822889:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752923.822989:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752923.823016:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182664576 00000100:00100000:2.0:1788752923.823024:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182664576 00000100:00100000:2.0:1788752923.823066:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809344 00000100:00100000:2.0:1788752923.823069:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809344 00000100:00100000:2.0:1788752923.823085:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788752923.823094:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3305:x1875643182664576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752923.823181:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90810450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3305:x1875643182664576:12345-0@lo:400:kworker.0 Request processed in 89us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752923.823188:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788752923.823220:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 254 00000100:00100000:2.0:1788752923.823226:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:9957:x1875643164809344:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788752923.823915:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.823950:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182664960 00000100:00100000:0.0:1788752923.823956:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182664960 00000100:00100000:0.0:1788752923.824006:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788752923.824015:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182664960:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788752923.824028:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:9957:x1875643164809344:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 799us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752923.824038:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 254 00002000:00000024:0.0:1788752923.824046:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752923.824085:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182664960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.824103:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788752923.824138:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788752923.824182:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbddf7100 x1875643182664960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752923.824204:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182664960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752923.824255:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182665216:0@lo:400:kworker.0 00000100:00100000:0.0:1788752923.824286:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.824310:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788752923.824316:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182665088:0@lo:400:kworker.0 00000100:00100000:0.0:1788752923.824339:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.824364:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665216 00000100:00100000:0.0:1788752923.824368:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665216 00000100:00100000:0.0:1788752923.824398:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788752923.824404:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182665216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752923.824441:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182665216:12345-0@lo:400:kworker.0 Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.824460:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788752923.824478:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665088 00000100:00100000:0.0:1788752923.824481:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665088 00000100:00100000:0.0:1788752923.824522:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788752923.824530:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182665088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752923.824561:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182665088:12345-0@lo:400:kworker.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.824568:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788752923.824585:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182664576:0@lo:400:kworker.0 00000100:00080000:0.0:1788752923.824586:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752923.824623:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182665088:0@lo:400:kworker.0 00000100:00100000:0.0:1788752923.824634:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182665216:0@lo:400:kworker.0 00000100:00100000:1.0:1788752923.835758:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182664704:12345-0@lo:400:kworker.0 Request processed in 17003us (17272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.835774:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788752923.835914:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182664704:0@lo:400:kworker.0 00000100:00100000:3.0:1788752923.837967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752923.838010:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182665344:0@lo:400:kworker.0 00000100:00100000:3.0:1788752923.838043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.838076:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182664832 00000100:00100000:0.0:1788752923.838087:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182664832 00000100:00100000:0.0:1788752923.838173:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788752923.838184:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182664832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752923.838247:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182664832:12345-0@lo:400:kworker.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.838255:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788752923.838277:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752923.838338:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665344 00000100:00100000:1.0:1788752923.838343:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665344 00000100:00100000:1.0:1788752923.838383:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788752923.838391:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182665344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752923.838429:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182665344:12345-0@lo:400:kworker.0 Request processed in 39us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.838435:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788752923.839364:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182664832:0@lo:400:kworker.0 00010000:00080000:3.0:1788752923.839384:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b9091c380 x1875643182665344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752923.839417:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182665344:0@lo:400:kworker.0 10000000:01000000:3.0:1788752923.882356:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788752923.882367:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bafe44000 from 7 10000000:01000000:3.0:1788752923.882372:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788752923.882420:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.882432:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.882444:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752923.882471:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182665472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788752923.882550:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.882622:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665472 00000100:00100000:3.0:1788752923.882628:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b99485780 going to sleep for 11 seconds 00000100:00100000:0.0:1788752923.882630:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665472 00000100:00100000:0.0:1788752923.882680:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788752923.882690:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+16:5829:x1875643182665472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788752923.882703:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752923.882715:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848fff1 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752923.882737:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848fff1 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752923.882747:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848fff1 expref: 17 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752923.882755:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8600, rc 0) 00000100:00100000:0.0:1788752923.882798:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90812c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182665472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.882816:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788752923.883078:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182665472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752923.883096:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.883104:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752923.892469:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182665600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752923.892558:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752923.892600:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0486780 going to sleep for 11 seconds 00000100:00100000:0.0:1788752923.892697:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665600 00000100:00100000:0.0:1788752923.892706:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665600 00000100:00100000:0.0:1788752923.892764:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788752923.892773:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182665600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.893070:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182665600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.893077:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788752923.893411:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182665600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752923.893456:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182665728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752923.893513:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752923.893550:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b99485780 going to sleep for 11 seconds 00000100:00100000:2.0:1788752923.894927:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665728 00000100:00100000:2.0:1788752923.894942:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665728 00000100:00100000:2.0:1788752923.895005:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788752923.895014:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182665728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788752923.895288:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182665728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752923.895303:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788752923.895719:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182665728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788752923.896849:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11664:1875643182665856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752923.896934:0:11664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752923.896971:0:11664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b99485840 going to sleep for 11 seconds 00000100:00100000:2.0:1788752923.897965:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665856 00000100:00100000:2.0:1788752923.897975:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665856 00000100:00100000:2.0:1788752923.898034:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788752923.898044:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:11664:x1875643182665856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788752923.898309:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:11664:x1875643182665856:12345-0@lo:502:llog_process_th.0 Request processed in 265us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752923.898317:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788752923.898492:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11664:1875643182665856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788752923.898539:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788752923.898548:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752923.898550:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788752923.898560:0:11664:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c9bafe44000 00000020:00000080:3.0:1788752923.898562:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788752923.898650:0:11664:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11664:1875643182665984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752923.898698:0:11664:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752923.898744:0:11664:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b88bd2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788752923.898824:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182665984 00000100:00100000:1.0:1788752923.898830:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182665984 00000100:00100000:1.0:1788752923.898875:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788752923.898883:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:11664:x1875643182665984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752923.899074:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:11664:x1875643182665984:12345-0@lo:502:llog_process_th.0 Request processed in 191us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.899082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788752923.901461:0:11664:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11664:1875643182665984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788752923.901517:0:11664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788752923.901525:0:11664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788752923.901528:0:11664:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788752923.901535:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788752923.902891:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788752923.902931:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788752923.902943:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752923.902956:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788752923.902969:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788752923.902971:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbd907800 from 7 10000000:01000000:2.0:1788752923.902973:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788752923.903012:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752923.903021:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752923.903031:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752923.903058:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788752923.903189:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752923.903264:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0486000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752923.903614:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182666112 00000100:00100000:3.0:1788752923.903622:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182666112 00000100:00100000:3.0:1788752923.903855:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788752923.903876:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+17:5829:x1875643182666112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788752923.903891:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752923.903904:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f48490006 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4848ffff expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.903943:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f48490006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4848ffff expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.903953:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f48490006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4848ffff expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752923.903961:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ca00, rc 0) 00000100:00100000:3.0:1788752923.904020:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182666112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752923.904027:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788752923.904687:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788752923.904882:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752923.904902:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752923.904976:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788752923.905018:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752923.905055:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0486000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752923.905175:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182666240 00000100:00100000:3.0:1788752923.905181:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182666240 00000100:00100000:3.0:1788752923.905219:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788752923.905226:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182666240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788752923.909700:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba01e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182666240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4463us (4669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752923.910482:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788752923.917061:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.917327:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.917406:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.917490:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788752923.918019:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182666368 00000100:00100000:1.0:1788752923.918028:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182666368 00000100:00100000:1.0:1788752923.918091:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788752923.918117:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182666368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788752923.918573:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182666368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 457us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.918582:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788752923.918695:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.919350:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11667:1875643182666496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752923.919403:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.919431:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788752923.919485:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182666496 00000100:00100000:1.0:1788752923.919491:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182666496 00000100:00100000:1.0:1788752923.919529:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788752923.919537:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:11667:x1875643182666496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788752923.919714:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:11667:x1875643182666496:12345-0@lo:502:llog_process_th.0 Request processed in 178us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.919721:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788752923.919814:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11667:1875643182666496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788752923.919839:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788752923.919848:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752923.919850:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788752923.919893:0:11667:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c9bbd907800 00000020:00000080:0.0:1788752923.919896:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788752923.919968:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11667:1875643182666624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752923.919998:0:11667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.920018:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752923.920207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182666624 00000100:00100000:0.0:1788752923.920212:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182666624 00000100:00100000:0.0:1788752923.920313:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788752923.920321:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:11667:x1875643182666624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752923.920464:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:11667:x1875643182666624:12345-0@lo:502:llog_process_th.0 Request processed in 144us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.920471:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788752923.920515:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11667:1875643182666624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788752923.920535:0:11667:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752923.920540:0:11667:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752923.920542:0:11667:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788752923.920546:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788752923.921066:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788752923.921084:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788752923.922310:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.922329:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752923.922341:0:5829:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788752923.922344:0:5829:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9b90a5a800 from 7 10000000:01000000:1.0:1788752923.922347:0:5829:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788752923.922388:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.922396:0:5829:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.922406:0:5829:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752923.922437:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788752923.922503:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752923.922544:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752923.922570:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182666752 00000100:00100000:1.0:1788752923.922576:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182666752 00000100:00100000:1.0:1788752923.922622:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788752923.922629:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+18:5829:x1875643182666752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788752923.922642:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752923.922654:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe270200/0x80c8383f48490014 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f4849000d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.922678:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe270200/0x80c8383f48490014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f4849000d expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.922688:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe270200/0x80c8383f48490014 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f4849000d expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.922697:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270200, rc 0) 00000100:00100000:1.0:1788752923.922733:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182666752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.922739:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788752923.922783:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788752923.922798:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.922807:0:5829:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752923.922879:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752923.922906:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752923.922922:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752923.922933:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182666880 00000100:00100000:1.0:1788752923.922937:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182666880 00000100:00100000:1.0:1788752923.922958:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788752923.922965:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182666880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788752923.924404:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182666880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1432us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.924416:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788752923.924524:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182666880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.924574:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182667008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788752923.924629:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.924664:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788752923.924713:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667008 00000100:00100000:1.0:1788752923.924719:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667008 00000100:00100000:1.0:1788752923.924758:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788752923.924765:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182667008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788752923.924961:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:5829:x1875643182667008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752923.924968:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788752923.925340:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b577cb32-91f9-472d-9b00-c1edbc016b63:5829:1875643182667008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788752923.932095:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbddf6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11668:1875643182667136:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788752923.932103:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788752923.932199:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752923.932437:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788752923.932821:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667136 00000100:00100000:3.0:1788752923.932828:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667136 00000100:00100000:3.0:1788752923.932895:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788752923.932904:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:11668:x1875643182667136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788752923.933208:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:11668:x1875643182667136:12345-0@lo:502:llog_process_th.0 Request processed in 304us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752923.933226:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788752923.935570:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbddf6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11668:1875643182667136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788752923.935616:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788752923.935626:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752923.935628:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788752923.935641:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c9b90a5a800 00000020:00000080:0.0:1788752923.935644:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788752923.935727:0:11668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11668:1875643182667264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752923.935797:0:11668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752923.935841:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667264 00000100:00100000:0.0:1788752923.935847:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667264 00000100:00100000:0.0:1788752923.935898:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788752923.935906:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:11668:x1875643182667264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788752923.937465:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:11668:x1875643182667264:12345-0@lo:502:llog_process_th.0 Request processed in 1551us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.937477:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788752923.937573:0:11668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752923.937598:0:11668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b577cb32-91f9-472d-9b00-c1edbc016b63:11668:1875643182667264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788752923.937636:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788752923.937645:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788752923.937647:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788752923.937652:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788752923.941371:0:5829:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788752923.941413:0:5829:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788752923.941424:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752923.941457:0:5829:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752923.958158:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752923.958196:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752923.958217:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752923.958249:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809600 00000100:00100000:2.0:1788752923.958257:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809600 00000100:00100000:2.0:1788752923.958312:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:2.0:1788752923.958321:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164809600:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752923.958390:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164809600:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752923.958397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00080000:2.0:1788752923.958421:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752923.958444:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809472 00000100:00100000:0.0:1788752923.958450:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809472 00000100:00100000:0.0:1788752923.958494:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809728 00000100:00100000:0.0:1788752923.958497:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809728 00000100:00080000:2.0:1788752923.958499:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752923.958524:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:2.0:1788752923.958536:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:0.0:1788752923.958537:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164809472:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752923.958549:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2361:x1875643164809728:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752923.958579:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164809472:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 47us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752923.958586:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2361:x1875643164809728:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752923.958599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:2.0:1788752923.958608:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 95 00010000:00010000:1.0:1788752924.586934:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788752924.972433:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788752925.610265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752926.637233:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788752927.462904:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:1.0:1788752927.658276:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752927.915622:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752927.916596:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182667392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752927.916664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752927.916933:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667392 00000100:00100000:3.0:1788752927.916942:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667392 00000100:00080000:2.0:1788752927.917022:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752927.917590:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788752927.917603:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182667392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752927.917639:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752927.917716:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182667392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752927.917723:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788752927.917791:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788752927.917797:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9bb54b0a80, transno 4294967300 00000100:00100000:1.0:1788752927.917822:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182667392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788752928.683492:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752928.938506:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182667776:0@lo:400:kworker.0 00000100:00100000:2.0:1788752928.938589:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752928.938664:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182668288:0@lo:400:kworker.0 00000100:00100000:2.0:1788752928.938692:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752928.938714:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788752928.938720:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182667904:0@lo:400:kworker.0 00000100:00100000:2.0:1788752928.938741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752928.938767:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667776 00000100:00100000:2.0:1788752928.938774:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667776 00000100:00100000:2.0:1788752928.938809:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667904 00000100:00100000:2.0:1788752928.938812:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667904 00000100:00100000:2.0:1788752928.938851:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788752928.938860:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182667776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752928.938922:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182667776:12345-0@lo:400:kworker.0 Request processed in 63us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752928.938929:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788752928.939054:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b87338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182667520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752928.939087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752928.939141:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182668032:0@lo:400:kworker.0 00000100:00100000:0.0:1788752928.939164:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752928.939196:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788752928.939202:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182667648:0@lo:400:kworker.0 00000100:00100000:0.0:1788752928.939244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752928.939263:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182668160:0@lo:400:kworker.0 00000100:00100000:0.0:1788752928.939285:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752928.939309:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667520 00000100:00100000:0.0:1788752928.939314:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667520 00000100:00100000:0.0:1788752928.939345:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788752928.939358:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182667520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752928.939385:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752928.939419:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182667520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752928.939426:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788752928.939446:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668288 00000100:00100000:0.0:1788752928.939450:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668288 00000100:00100000:0.0:1788752928.939469:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668032 00000100:00100000:0.0:1788752928.939472:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668032 00000100:00100000:0.0:1788752928.939490:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788752928.939496:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182668288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752928.939524:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182668288:12345-0@lo:400:kworker.0 Request processed in 28us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752928.939529:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788752928.939540:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788752928.939546:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182668032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752928.939571:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182668032:12345-0@lo:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752928.939576:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788752928.939629:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b87338a80 x1875643182667520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752928.939651:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b87338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182667520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752928.939662:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182668032:0@lo:400:kworker.0 00000100:00080000:0.0:1788752928.939701:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788752928.939706:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788752928.939730:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b9091c700 x1875643182668288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788752928.939739:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182668288:0@lo:400:kworker.0 00000100:00100000:0.0:1788752928.939753:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182667776:0@lo:400:kworker.0 00000100:00100000:2.0:1788752928.939792:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668160 00000100:00100000:2.0:1788752928.939798:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668160 00000100:00100000:2.0:1788752928.939827:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788752928.939847:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182667904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752928.939885:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182667904:12345-0@lo:400:kworker.0 Request processed in 40us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752928.939891:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788752928.939910:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788752928.939915:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182668160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752928.939948:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182668160:12345-0@lo:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752928.939953:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788752928.939977:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182668160:0@lo:400:kworker.0 00000100:00100000:1.0:1788752928.940177:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182667648 00000100:00100000:1.0:1788752928.940183:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182667648 00000100:00100000:1.0:1788752928.940274:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788752928.940282:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182667648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752928.940323:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182667648:12345-0@lo:400:kworker.0 Request processed in 43us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752928.940330:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788752928.940366:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182667648:0@lo:400:kworker.0 00000100:00080000:0.0:1788752928.940628:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752928.940650:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182667904:0@lo:400:kworker.0 00000100:00100000:2.0:1788752929.086380:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752929.087245:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752929.087276:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752929.087314:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752929.087356:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809984 00000100:00100000:2.0:1788752929.087365:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809984 00000100:00100000:1.0:1788752929.087655:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164809856 00000100:00100000:1.0:1788752929.087660:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164809856 00000100:00100000:1.0:1788752929.087697:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00100000:1.0:1788752929.087707:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164809856:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752929.087795:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164809856:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 89us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752929.087803:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 271 00000100:00080000:0.0:1788752929.087936:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752929.088347:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164810112 00000100:00100000:3.0:1788752929.088360:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164810112 00000100:00100000:3.0:1788752929.088453:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:3.0:1788752929.088876:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164810112:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752929.088962:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164810112:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 500us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752929.088970:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00080000:3.0:1788752929.089004:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752929.089041:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164810240 00000100:00100000:3.0:1788752929.089047:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164810240 00000100:00100000:3.0:1788752929.089083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:3.0:1788752929.089092:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164809984:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752929.089175:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164809984:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 85us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752929.089182:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:3.0:1788752929.089272:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:3.0:1788752929.089279:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164810240:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752929.089325:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164810240:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 45us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752929.089331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00080000:3.0:1788752929.089352:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788752929.709403:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752930.730659:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752931.755472:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752932.779044:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752933.035118:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182668416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752933.035202:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752933.035272:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668416 00000100:00100000:3.0:1788752933.035280:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668416 00000100:00100000:3.0:1788752933.035343:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788752933.035352:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182668416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752933.035385:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752933.035426:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182668416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752933.035433:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788752933.035475:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182668416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788752933.035604:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788752933.802302:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752934.058928:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182668928:0@lo:400:kworker.0 00000100:00100000:1.0:1788752934.059097:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182668544:0@lo:400:kworker.0 00000100:00100000:1.0:1788752934.059191:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752934.059256:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182669184:0@lo:400:kworker.0 00000100:00100000:1.0:1788752934.059282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752934.059330:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788752934.059336:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182668672:0@lo:400:kworker.0 00000100:00100000:1.0:1788752934.059356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752934.059601:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182669056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752934.059626:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752934.059669:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669184 00000100:00100000:1.0:1788752934.059676:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669184 00000100:00100000:1.0:1788752934.059724:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668672 00000100:00100000:1.0:1788752934.059727:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668672 00000100:00100000:1.0:1788752934.059745:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788752934.059752:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182669184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752934.059808:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182669184:12345-0@lo:400:kworker.0 Request processed in 56us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752934.059814:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788752934.059828:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788752934.059834:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182668672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752934.059871:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182668672:12345-0@lo:400:kworker.0 Request processed in 38us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752934.059877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788752934.059896:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752934.059919:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182668672:0@lo:400:kworker.0 00000100:00100000:1.0:1788752934.059929:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182669184:0@lo:400:kworker.0 00000100:00100000:2.0:1788752934.060091:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668544 00000100:00100000:2.0:1788752934.060095:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668544 00000100:00100000:2.0:1788752934.060141:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788752934.060147:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182668544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752934.060178:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182668544:12345-0@lo:400:kworker.0 Request processed in 32us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752934.060184:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788752934.060272:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182668544:0@lo:400:kworker.0 00000100:00100000:3.0:1788752934.060787:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752934.060828:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788752934.060836:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182668800:0@lo:400:kworker.0 00000100:00100000:3.0:1788752934.060859:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752934.060872:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182669312:0@lo:400:kworker.0 00000100:00100000:3.0:1788752934.060891:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752934.061085:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668928 00000100:00100000:2.0:1788752934.061091:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668928 00000100:00100000:2.0:1788752934.061145:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669312 00000100:00100000:2.0:1788752934.061148:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669312 00000100:00100000:2.0:1788752934.061176:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788752934.061183:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182668928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752934.061235:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182668928:12345-0@lo:400:kworker.0 Request processed in 52us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752934.061243:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788752934.061273:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788752934.061279:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182669312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752934.061438:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182669312:12345-0@lo:400:kworker.0 Request processed in 159us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752934.061445:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788752934.061469:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788752934.061608:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9b9091c380 x1875643182669312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788752950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752934.061621:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182669312:0@lo:400:kworker.0 00000100:00100000:3.0:1788752934.061638:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182668928:0@lo:400:kworker.0 00000100:00100000:0.0:1788752934.061711:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669056 00000100:00100000:0.0:1788752934.061716:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669056 00000100:00100000:0.0:1788752934.061749:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788752934.061756:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182669056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752934.061784:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752934.061836:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182669056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (2208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752934.061842:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788752934.061861:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182668800 00000100:00100000:0.0:1788752934.061864:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182668800 00000100:00100000:0.0:1788752934.061890:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788752934.061895:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182668800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752934.061932:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182668800:12345-0@lo:400:kworker.0 Request processed in 37us (1073us total) trans 0 rc 0/0 00010000:00080000:2.0:1788752934.062101:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef50700 x1875643182669056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752934.062116:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182669056:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788752934.062162:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752934.062230:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182668800:0@lo:400:kworker.0 00000100:00100000:0.0:1788752934.062284:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000040:00080000:2.0:1788752934.187863:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788752934.195059:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752934.195107:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752934.195303:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164810368 00000100:00100000:1.0:1788752934.195322:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164810368 00000100:00100000:1.0:1788752934.195382:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00100000:1.0:1788752934.195393:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164810368:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752934.195480:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164810368:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 88us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752934.195489:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 273 00000100:00100000:2.0:1788752934.196000:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752934.196028:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752934.196070:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164810624 00000100:00100000:0.0:1788752934.196076:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164810624 00000100:00100000:0.0:1788752934.196147:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:0.0:1788752934.196156:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164810624:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752934.196215:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164810624:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752934.196223:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00080000:1.0:1788752934.196595:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788752934.200499:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164810496 00000100:00100000:1.0:1788752934.200519:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164810496 00000100:00100000:1.0:1788752934.200604:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164810752 00000100:00100000:1.0:1788752934.200608:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164810752 00000100:00100000:1.0:1788752934.200640:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:1.0:1788752934.200651:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164810496:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752934.200730:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164810496:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 81us (5622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752934.200738:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:1.0:1788752934.200756:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 105 00000100:00100000:1.0:1788752934.200779:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164810752:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752934.200822:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164810752:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 44us (4793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752934.200829:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 105 00000100:00080000:0.0:1788752934.200902:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788752934.826296:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752935.850412:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752936.876996:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752937.898324:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752938.154705:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752938.154737:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182669440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752938.154844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752938.155208:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669440 00000100:00100000:3.0:1788752938.155219:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669440 00000100:00100000:3.0:1788752938.155307:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788752938.155319:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182669440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752938.155450:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752938.155519:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182669440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752938.155528:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788752938.155614:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788752938.155666:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182669440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788752938.923502:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752939.178384:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182669568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752939.178460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752939.178599:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669568 00000100:00100000:0.0:1788752939.178609:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669568 00000100:00100000:0.0:1788752939.178736:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788752939.178747:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182669568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752939.178801:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752939.179213:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182669696:0@lo:400:kworker.0 00000100:00100000:2.0:1788752939.179256:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752939.179296:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669696 00000100:00100000:2.0:1788752939.179301:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669696 00000100:00100000:2.0:1788752939.179330:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788752939.179337:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182669696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752939.179388:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3306:x1875643182669696:12345-0@lo:400:kworker.0 Request processed in 52us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752939.179396:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788752939.179449:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182669696:0@lo:400:kworker.0 00000100:00080000:2.0:1788752939.179563:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788752939.181929:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182669952:0@lo:400:kworker.0 00000100:00100000:3.0:1788752939.182092:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752939.182185:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182669568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3431us (3716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752939.182201:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788752939.182242:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788752939.182311:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182670208:0@lo:400:kworker.0 00000100:00100000:0.0:1788752939.182372:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752939.182404:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788752939.182406:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182669824:0@lo:400:kworker.0 00000100:00100000:0.0:1788752939.182418:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182670080:0@lo:400:kworker.0 00000100:00100000:0.0:1788752939.182447:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752939.182478:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669952 00000100:00100000:0.0:1788752939.182485:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669952 00000100:00100000:0.0:1788752939.182544:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670208 00000100:00100000:0.0:1788752939.182547:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670208 00000100:00100000:0.0:1788752939.182571:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788752939.182580:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182669952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752939.182629:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182669952:12345-0@lo:400:kworker.0 Request processed in 51us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752939.182975:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788752939.182986:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182670208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752939.183028:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182670208:12345-0@lo:400:kworker.0 Request processed in 45us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752939.183035:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788752939.183084:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670080 00000100:00100000:2.0:1788752939.183088:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670080 00000100:00100000:2.0:1788752939.183116:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788752939.183143:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182670080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752939.183175:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182670080:12345-0@lo:400:kworker.0 Request processed in 54us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752939.183182:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1788752939.183201:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752939.183244:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182670080:0@lo:400:kworker.0 00000100:00100000:2.0:1788752939.183255:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182670208:0@lo:400:kworker.0 00000100:00100000:0.0:1788752939.183591:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1788752939.183831:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef51f80 x1875643182669568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752939.183852:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182669568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752939.186657:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752939.186776:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182669952:0@lo:400:kworker.0 00000100:00100000:2.0:1788752939.187259:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182669824 00000100:00100000:2.0:1788752939.187269:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182669824 00000100:00100000:2.0:1788752939.187343:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788752939.187355:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182669824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752939.187832:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182669824:12345-0@lo:400:kworker.0 Request processed in 477us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752939.187865:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788752939.188023:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182669824:0@lo:400:kworker.0 00000100:00100000:1.0:1788752939.315060:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752939.315247:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752939.315313:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811008 00000100:00100000:2.0:1788752939.315329:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811008 00000100:00100000:2.0:1788752939.315433:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00100000:2.0:1788752939.315444:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164811008:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752939.315531:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164811008:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 89us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752939.315539:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00080000:3.0:1788752939.315858:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752939.317511:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164810880 00000100:00100000:0.0:1788752939.317529:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164810880 00000100:00100000:0.0:1788752939.317611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:0.0:1788752939.317624:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164810880:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752939.317726:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164810880:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 105us (2678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752939.317734:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 275 00000100:00100000:1.0:1788752939.322617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752939.322667:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752939.322838:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811264 00000100:00100000:2.0:1788752939.322848:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811264 00000100:00100000:2.0:1788752939.322919:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:2.0:1788752939.322927:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164811264:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752939.323000:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164811264:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 74us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752939.323006:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00080000:3.0:1788752939.323373:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752939.323517:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811136 00000100:00100000:0.0:1788752939.323523:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811136 00000100:00100000:0.0:1788752939.323575:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:0.0:1788752939.323583:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2357:x1875643164811136:12345-192.168.203.5@tcp:9:kworker.0 00000020:00000080:0.0:1788752939.323604:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848ff50 00000100:00080000:0.0:1788752939.323614:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5b99000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788752939.323659:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1788752939.323822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788752939.323857:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752939.324072:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+2:2357:x1875643164811136:12345-192.168.203.5@tcp:9:kworker.0 Request processed in 488us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752939.324080:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00010000:00010000:1.0:1788752939.946376:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752940.972155:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752941.994356:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788752942.799500:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:3.0:1788752942.799512:0:6714:0:(genops.c:885:class_export_put()) final put ffff9c9bb5b9f000/240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:1.0:1788752942.799685:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bb5b9f000/240b527c-392e-42d3-b78c-b594aea00353 for lustre-OST0000 00000020:00000080:1.0:1788752942.799765:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9bb5b99000 for lustre-OST0000 00010000:00010000:1.0:1788752943.019218:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752943.278425:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182670336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752943.278493:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752943.278566:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670336 00000100:00100000:2.0:1788752943.278575:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670336 00000100:00100000:2.0:1788752943.278628:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788752943.278636:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182670336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788752943.278670:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752943.278726:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182670336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752943.278752:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788752943.278775:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752943.278811:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182670336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788752944.053293:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752944.298441:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182670464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752944.298515:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752944.299250:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788752944.299278:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182670848:0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.299302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752944.299337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752944.299348:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788752944.299365:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788752944.299373:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182670976:0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.299382:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752944.299406:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752944.299410:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788752944.299420:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182670720:0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.299449:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752944.299493:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670592 00000100:00100000:1.0:1788752944.299500:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670592 00000100:00100000:1.0:1788752944.299552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788752944.299563:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182670592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.299616:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182670592:12345-0@lo:400:kworker.0 Request processed in 55us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752944.299623:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788752944.299653:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670848 00000100:00100000:1.0:1788752944.299657:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670848 00000100:00100000:1.0:1788752944.299700:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182671104 00000100:00100000:1.0:1788752944.299704:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182671104 00000100:00100000:1.0:1788752944.299716:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670720 00000100:00100000:1.0:1788752944.299718:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670720 00000100:00100000:1.0:1788752944.299742:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788752944.299749:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182670848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.299791:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182670848:12345-0@lo:400:kworker.0 Request processed in 41us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752944.299797:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788752944.299810:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788752944.299816:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182671104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.299853:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182671104:12345-0@lo:400:kworker.0 Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752944.299859:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788752944.299870:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788752944.299875:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182670720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.300017:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182670720:12345-0@lo:400:kworker.0 Request processed in 141us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752944.300023:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788752944.300042:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670464 00000100:00100000:2.0:1788752944.300048:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670464 00000100:00100000:1.0:1788752944.300066:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182670720:0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.300080:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182671104:0@lo:400:kworker.0 00000100:00100000:1.0:1788752944.300086:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788752944.300498:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182670848:0@lo:400:kworker.0 00000100:00100000:2.0:1788752944.300520:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788752944.300531:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182670464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788752944.300560:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752944.300613:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182670464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752944.300619:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788752944.300643:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182670976 00000100:00100000:2.0:1788752944.300647:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182670976 00000100:00100000:2.0:1788752944.300671:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788752944.300676:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182670976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752944.300708:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182670976:12345-0@lo:400:kworker.0 Request processed in 32us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752944.300714:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788752944.300748:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788752944.300754:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788752944.300777:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9baef53100 x1875643182670464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788752960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752944.300784:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182670976:0@lo:400:kworker.0 00000100:00100000:3.0:1788752944.300802:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182670464:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788752944.426736:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788752944.440286:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752944.440366:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752944.440400:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752944.440428:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811648 00000100:00100000:1.0:1788752944.440436:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811648 00000100:00100000:1.0:1788752944.440487:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811520 00000100:00100000:1.0:1788752944.440490:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811520 00000100:00100000:1.0:1788752944.440514:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:1.0:1788752944.440523:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164811648:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752944.440591:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164811648:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752944.440598:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:1.0:1788752944.440614:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:1.0:1788752944.440620:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164811520:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752944.440651:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164811520:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 31us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752944.440657:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00080000:2.0:1788752944.440712:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752944.444239:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811392 00000100:00100000:0.0:1788752944.444254:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811392 00000100:00100000:0.0:1788752944.444408:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 277 00000100:00100000:0.0:1788752944.444419:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164811392:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752944.444508:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164811392:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 92us (4234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752944.444516:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 277 00010000:00010000:1.0:1788752945.066290:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788752946.075830:0:11835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:49:05 (1788752945) 00010000:00010000:1.0:1788752946.090250:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752947.115910:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752947.140585:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752947.140661:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811776 00000100:00100000:2.0:1788752947.140679:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811776 00000100:00100000:2.0:1788752947.140819:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:2.0:1788752947.140835:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+5:10227:x1875643164811776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752947.140863:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752947.140893:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4849001b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef52 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.140981:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490022 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.140998:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.141014:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752947.141066:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788752947.141070:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752947.141119:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490022 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.141209:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f4849001b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef52 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.141233:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490022 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef52 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.141242:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426000) 00010000:00010000:2.0:1788752947.141245:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752947.141249:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929c00, rc 0) 00000100:00100000:2.0:1788752947.141333:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+6:10227:x1875643164811776:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 504us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752947.141356:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00080000:0.0:1788752947.142539:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752947.147618:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752947.147741:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164811904 00000100:00100000:1.0:1788752947.147754:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164811904 00000100:00100000:1.0:1788752947.147832:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:1.0:1788752947.147844:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+6:10228:x1875643164811904:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752947.147871:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752947.147896:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef59 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.147976:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.147993:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148007:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148023:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148030:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148037:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148398:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4849003e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148409:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4849003e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148417:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4849003e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752947.148452:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788752947.148457:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752947.148482:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4849003e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148495:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148503:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148511:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148519:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752947.148524:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148531:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148545:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426000) 00010000:00010000:1.0:1788752947.148555:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752947.148561:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148569:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148583:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148589:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148595:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148600:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752947.148603:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148610:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148617:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c9ba3667b00) 00010000:00010000:1.0:1788752947.148620:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752947.148623:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148628:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490037 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148664:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef59 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148691:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4849003e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef59 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752947.148699:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c9ba3667300) 00010000:00010000:1.0:1788752947.148702:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788752947.148705:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270a00, rc 0) 00000100:00100000:1.0:1788752947.148801:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+7:10228:x1875643164811904:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 959us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752947.148810:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:3.0:1788752947.154545:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752947.154639:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164812160 00000100:00100000:2.0:1788752947.154653:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164812160 00000100:00100000:2.0:1788752947.154737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:2.0:1788752947.154751:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+7:10228:x1875643164812160:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752947.154781:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752947.154808:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490045 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef60 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.155222:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.155239:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.155378:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.155553:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.155575:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.155588:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156447:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4849005a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156467:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4849005a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156475:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4849005a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752947.156488:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788752947.156655:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156663:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156670:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156677:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752947.156681:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156688:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156700:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c9ba3667300) 00010000:00010000:2.0:1788752947.156703:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752947.156717:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156724:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849004c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156738:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156749:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156756:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156761:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752947.156764:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156771:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156778:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c9b89426200) 00010000:00010000:2.0:1788752947.156781:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752947.156784:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.156791:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f48490053 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.157286:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490045 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef60 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.157303:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4849005a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef60 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752947.157311:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:2.0:1788752947.157313:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752947.157322:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929600, rc 0) 00000100:00100000:2.0:1788752947.157402:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+9:10228:x1875643164812160:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2654us (2869us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788752947.157411:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:2.0:1788752947.160852:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752947.160954:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164812288 00000100:00100000:1.0:1788752947.160971:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164812288 00000100:00100000:1.0:1788752947.161241:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:1.0:1788752947.161254:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+9:10228:x1875643164812288:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788752947.161396:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+9:10228:x1875643164812288:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 144us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752947.161404:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000040:00080000:3.0:1788752947.504988:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788752947.924683:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1788752948.138314:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752948.394368:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182671232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752948.394442:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752948.394495:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182671232 00000100:00100000:2.0:1788752948.394506:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182671232 00000100:00080000:0.0:1788752948.394569:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752948.394578:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788752948.394589:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182671232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788752948.394624:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752948.394682:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182671232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752948.394689:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788752948.394730:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182671232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752948.799111:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752948.799505:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164812416 00000100:00100000:1.0:1788752948.799515:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164812416 00000100:00100000:1.0:1788752948.799573:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:1.0:1788752948.799584:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+8:10270:x1875643164812416:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752948.799606:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752948.799625:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef67 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799719:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799733:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799745:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799760:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799767:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799773:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799959:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799967:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799974:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.799980:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752948.799984:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800000:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800012:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426000) 00010000:00010000:1.0:1788752948.800014:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752948.800019:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800025:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f4849006f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800036:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800042:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800048:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800052:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752948.800055:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800061:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800067:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c9ba3667400) 00010000:00010000:1.0:1788752948.800070:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752948.800072:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800086:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800152:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490068 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef67 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800163:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426000) 00010000:00010000:1.0:1788752948.800165:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752948.800169:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef67 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.800178:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271800, rc 0) 00000100:00100000:1.0:1788752948.800237:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+8:10270:x1875643164812416:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 655us (1139us total) trans 0 rc 301/301 00000100:00100000:1.0:1788752948.800244:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:3.0:1788752948.806594:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752948.806673:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164812672 00000100:00100000:0.0:1788752948.806684:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164812672 00000100:00100000:0.0:1788752948.806756:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1788752948.806767:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+8:10270:x1875643164812672:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:0.0:1788752948.806820:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752948.806847:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490022 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef52 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.806865:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426000) 00010000:00010000:0.0:1788752948.806876:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788752948.807104:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.807117:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.807181:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.807197:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.807204:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.807211:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752948.808089:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788752948.808103:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.808111:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.808119:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.808158:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752948.808162:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.808170:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.808183:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b9424b200) 00010000:00010000:0.0:1788752948.808186:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752948.808198:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.808204:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849007d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752948.808220:0:5834:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003435087a reply state 00000000634665e9 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752948.808229:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788752948.808340:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+9:10270:x1875643164812672:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 1572us (1756us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788752948.808349:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00010000:00010000:1.0:1788752948.810793:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.810812:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.810820:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.810826:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752948.810829:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.810836:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.810864:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c9b9424b100) 00010000:00010000:1.0:1788752948.810867:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752948.810872:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.810880:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490084 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752948.878250:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752948.878356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164812800 00000100:00100000:1.0:1788752948.878371:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164812800 00000100:00100000:1.0:1788752948.878451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:1.0:1788752948.878462:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+8:10278:x1875643164812800:12345-192.168.203.5@tcp:101:lctl.0 00010000:00010000:1.0:1788752948.878487:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752948.878511:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849008b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef6e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.878577:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490092 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.878592:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.878604:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752948.878640:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788752948.878644:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752948.878684:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490092 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.878743:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849008b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef6e expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.878763:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490092 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef6e expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.878772:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:1.0:1788752948.878774:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788752948.878778:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270400, rc 0) 00000100:00100000:1.0:1788752948.878864:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+9:10278:x1875643164812800:12345-192.168.203.5@tcp:101:lctl.0 Request processed in 404us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752948.878872:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:2.0:1788752948.929025:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752948.929194:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164812928 00000100:00100000:0.0:1788752948.929209:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164812928 00000100:00100000:0.0:1788752948.929272:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:0.0:1788752948.929282:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+9:10284:x1875643164812928:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1788752948.929306:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752948.929330:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef75 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929396:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929411:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929422:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929435:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929458:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929465:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929556:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9e00/0x80c8383f484900ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929564:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9e00/0x80c8383f484900ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929572:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9e00/0x80c8383f484900ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752948.929602:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788752948.929605:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752948.929643:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9e00/0x80c8383f484900ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929655:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929661:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929668:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929674:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752948.929677:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929690:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929713:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:0.0:1788752948.929716:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752948.929721:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929726:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484900a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929739:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929744:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929750:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929754:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752948.929757:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929762:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929767:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c9b9424b200) 00010000:00010000:0.0:1788752948.929769:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752948.929771:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929786:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484900a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929816:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef75 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929829:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9e00/0x80c8383f484900ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef75 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.929836:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752948.929839:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788752948.929841:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9e00, rc 0) 00000100:00100000:0.0:1788752948.929916:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+10:10284:x1875643164812928:12345-192.168.203.5@tcp:101:bash.0 Request processed in 635us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752948.929924:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:2.0:1788752948.937475:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752948.939316:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164813184 00000100:00100000:1.0:1788752948.939333:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164813184 00000100:00100000:1.0:1788752948.940330:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1788752948.940350:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+10:10284:x1875643164813184:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752948.940381:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752948.940408:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f484900b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef7c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.940572:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.940590:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.940603:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.944537:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.944562:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.944575:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788752948.947236:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788752948.947498:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947514:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947525:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947561:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947569:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947576:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947582:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752948.947586:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947609:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947620:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:1.0:1788752948.947623:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752948.947629:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.947634:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484900bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788752948.947649:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000004e6b02dd reply state 000000001c433a31 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752948.947658:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788752948.947710:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f484900b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.948303:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752948.948313:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:1.0:1788752948.948315:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752948.948318:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270800, rc 0) 00000100:00100000:1.0:1788752948.948404:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+13:10284:x1875643164813184:12345-192.168.203.5@tcp:101:bash.0 Request processed in 8062us (11047us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788752948.948412:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00010000:00010000:0.0:1788752948.955253:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.955275:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.955283:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.955289:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752948.955294:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.955302:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.955335:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba3667000) 00010000:00010000:0.0:1788752948.955339:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752948.955344:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.955350:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484900c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752948.958304:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752948.958389:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164813312 00000100:00100000:0.0:1788752948.958398:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164813312 00000100:00100000:0.0:1788752948.958444:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:0.0:1788752948.958453:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875643164813312:12345-192.168.203.5@tcp:8:bash.0 00010000:00080000:0.0:1788752948.958495:0:9256:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:0.0:1788752948.958532:0:9256:0:(genops.c:1384:class_connect()) connect: client 240b527c-392e-42d3-b78c-b594aea00353, cookie 0x80c8383f484900d8 00002000:00100000:0.0:1788752948.958545:0:9256:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 240b527c-392e-42d3-b78c-b594aea00353/ffff9c9b89418800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788752948.958570:0:9256:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788752948.958876:0:9256:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788752948.958907:0:9256:0:(import.c:65:import_set_state_nolock()) ffff9c9b8941c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788752948.959226:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2357:x1875643164813312:12345-192.168.203.5@tcp:8:bash.0 Request processed in 771us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752948.959236:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:2.0:1788752948.966945:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752948.970552:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164813440 00000100:00100000:0.0:1788752948.970576:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164813440 00000100:00100000:0.0:1788752948.970774:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1788752948.970786:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:0:x1875643164813440:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1788752948.970813:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752948.970858:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef83 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788752948.970892:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788752948.970912:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1788752948.970922:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752948.970931:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.970952:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.970965:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9800, rc 0) 00000100:00100000:0.0:1788752948.973429:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:0:x1875643164813440:12345-192.168.203.5@tcp:101:bash.0 Request processed in 2627us (6478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752948.973447:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00080000:2.0:1788752948.976238:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788752948.980682:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752948.983257:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164813568 00000100:00100000:2.0:1788752948.983274:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164813568 00000100:00100000:2.0:1788752948.983436:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:2.0:1788752948.983451:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:10284:x1875643164813568:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1788752948.983478:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752948.983508:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef8a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752948.983550:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752948.983578:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752948.983583:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752948.983590:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752948.983635:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752948.983652:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 8 pid: 6691 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752948.983669:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182671360:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752948.983867:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b88a6bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788752948.990561:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182671360:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752948.990627:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752948.990651:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928a00, rc 0) 00000100:00100000:3.0:1788752948.990678:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752948.990898:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164813696 00000100:00100000:0.0:1788752948.990908:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164813696 00000100:00100000:2.0:1788752948.990946:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+9:10284:x1875643164813568:12345-192.168.203.5@tcp:101:bash.0 Request processed in 7497us (10274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752948.990957:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00010000:00010000:0.0:1788752948.991086:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 8 pid: 6691 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752948.991180:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:0.0:1788752948.991192:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+8:2358:x1875643164813696:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752948.991215:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752948.991245:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 8 pid: 6691 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.991284:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 8 pid: 6691 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.991311:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f484900df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef83 expref: 8 pid: 6691 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.991327:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752948.991331:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752948.991341:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.991351:0:11152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752948.991398:0:11152:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752948.991658:0:11152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11152:1875643182671488:192.168.203.5@tcp:105: 00000100:00100000:0.0:1788752948.991854:0:11152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba1826300 going to sleep for 11 seconds 00000100:00100000:0.0:1788752948.994272:0:11152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11152:1875643182671488:192.168.203.5@tcp:105: 00010000:00010000:0.0:1788752948.994308:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752948.994376:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+7:2358:x1875643164813696:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 3185us (3699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752948.994388:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:1.0:1788752948.997227:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752948.997391:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164813952 00000100:00100000:2.0:1788752948.997405:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164813952 00000100:00100000:2.0:1788752948.997530:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788752948.997562:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+12:10284:x1875643164813952:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:2.0:1788752948.998056:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+13:10284:x1875643164813952:12345-192.168.203.5@tcp:35:bash.0 Request processed in 496us (839us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788752948.998065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788752949.061335:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752949.061524:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164814208 00000100:00100000:1.0:1788752949.061556:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164814208 00000100:00100000:1.0:1788752949.061657:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:1.0:1788752949.061671:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+13:10294:x1875643164814208:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752949.061715:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752949.061746:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f484900ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef91 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752949.061876:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788752949.062043:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f484900ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef91 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.062060:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:1.0:1788752949.062063:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752949.062070:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f484900ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef91 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.062089:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271600, rc 0) 00000100:00100000:1.0:1788752949.062204:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+14:10294:x1875643164814208:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 536us (888us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788752949.062213:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00080000:2.0:1788752949.062594:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752949.066989:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.067103:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164814464 00000100:00100000:0.0:1788752949.067115:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164814464 00000100:00100000:0.0:1788752949.067496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:0.0:1788752949.067511:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+14:10294:x1875643164814464:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752949.068719:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+15:10294:x1875643164814464:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 1203us (1734us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788752949.068733:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1788752949.133701:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752949.133854:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164814592 00000100:00100000:3.0:1788752949.133866:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164814592 00000100:00100000:3.0:1788752949.133939:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:3.0:1788752949.133951:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+15:10300:x1875643164814592:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752949.133981:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752949.134008:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f484900fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef98 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.134094:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490102 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.134170:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.134186:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752949.134232:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788752949.134237:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788752949.134263:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490102 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.134294:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f484900fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef98 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.134315:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490102 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef98 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.134337:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752949.134341:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788752949.134345:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d200, rc 0) 00000100:00100000:3.0:1788752949.134429:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+16:10300:x1875643164814592:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 480us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752949.134438:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:3.0:1788752949.141863:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752949.142051:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164814848 00000100:00100000:1.0:1788752949.142064:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164814848 00000100:00100000:1.0:1788752949.142173:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:1.0:1788752949.142186:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+16:10300:x1875643164814848:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752949.142214:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752949.142243:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852ef9f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.147648:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.147706:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.147725:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752949.147759:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788752949.147995:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef9f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.148021:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef9f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.148031:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:1.0:1788752949.148034:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752949.148039:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270c00, rc 0) 00000100:00100000:1.0:1788752949.148538:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+18:10300:x1875643164814848:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 6352us (6685us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788752949.148549:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:2.0:1788752949.153074:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752949.153118:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.153323:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164815232 00000100:00100000:0.0:1788752949.153346:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164815232 00000100:00100000:0.0:1788752949.153434:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:0.0:1788752949.153446:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+18:10300:x1875643164815232:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752949.153483:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752949.153510:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849011e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efa6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.153651:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490125 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.153670:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.153685:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752949.153711:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788752949.153873:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849011e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efa6 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.153893:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efa6 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.153919:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:0.0:1788752949.153922:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788752949.153926:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8e00, rc 0) 00000100:00100000:0.0:1788752949.154011:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+20:10300:x1875643164815232:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 567us (891us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788752949.154018:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:3.0:1788752949.155857:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164814976 00000100:00100000:3.0:1788752949.155874:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164814976 00000100:00100000:3.0:1788752949.155968:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1788752949.155980:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+20:2359:x1875643164814976:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752949.156016:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752949.156046:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef9f expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.156073:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752949.156078:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752949.156645:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+19:2359:x1875643164814976:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 664us (3580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752949.156654:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00010000:00010000:1.0:1788752949.163034:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752949.163751:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752949.163953:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164815360 00000100:00100000:3.0:1788752949.163967:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164815360 00000100:00100000:3.0:1788752949.164081:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:3.0:1788752949.164094:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164815360:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:3.0:1788752949.164182:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.164208:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.164218:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752949.164223:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752949.164228:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.164273:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.164336:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 7 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752949.164357:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875643182671616:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752949.164475:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baff61480 going to sleep for 11 seconds 00000100:00100000:3.0:1788752949.168515:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875643182671616:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752949.168562:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752949.172331:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.172460:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164815488 00000100:00100000:0.0:1788752949.172476:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164815488 00002000:00100000:0.0:1788752949.172541:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9c9bbe07d880 x1875643164815488/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:165/0 lens 504/0 e 0 to 0 dl 1788752960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752949.172554:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbe07d880 with x1875643164815488 ext(0->12) 00010000:00010000:0.0:1788752949.172565:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 8 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.172585:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 8 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788752949.172594:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c9bbe07d880 00000100:00100000:0.0:1788752949.172640:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:0.0:1788752949.172652:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164815488:12345-192.168.203.5@tcp:4:lfs.0 00000001:00100000:1.0:1788752949.209594:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000100:00100000:3.0:1788752949.210560:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164815488:12345-192.168.203.5@tcp:4:lfs.0 Request processed in 37903us (38235us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788752949.210577:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00002000:00100000:3.0:1788752949.210591:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9c9bbe07d880 x1875643164815488/t4294967299(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:165/0 lens 504/448 e 0 to 0 dl 1788752960 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788752949.210601:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbe07d880 with x1875643164815488 ext(0->12) 00010000:00010000:3.0:1788752949.210611:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 9 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.210631:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 9 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788752949.210640:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c9bbe07d880 00000100:00100000:0.0:1788752949.214082:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752949.214216:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164815616 00000100:00100000:2.0:1788752949.214226:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164815616 00010000:00010000:2.0:1788752949.214267:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 9 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752949.214311:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:2.0:1788752949.214321:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+9:2358:x1875643164815616:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752949.214336:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788752949.214355:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788752949.214358:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788752949 00002000:00010000:2.0:1788752949.214361:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788752949 00002000:00010000:2.0:1788752949.214363:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788752949 00010000:00010000:2.0:1788752949.214369:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 9 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.214383:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 9 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.214430:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baf9ec0a/0x80c8383f484900e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef8a expref: 9 pid: 6688 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.214450:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752949.214455:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752949.214462:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.214472:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.214505:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752949.214606:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752949.214624:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2358:x1875643164815616:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 303us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752949.214650:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00010000:00010000:3.0:1788752949.214653:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.214710:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.214720:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.214730:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.214739:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788752949.214745:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.214755:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.214780:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.214789:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f48490133 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752949.214898:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164815360:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 50803us (51150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752949.214908:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1788752949.220207:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752949.220315:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164815872 00000100:00100000:2.0:1788752949.220326:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164815872 00000100:00100000:2.0:1788752949.220383:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1788752949.220393:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+19:10300:x1875643164815872:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:2.0:1788752949.220458:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efa6 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788752949.220758:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788752949.220812:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788752949.221341:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788752949.221386:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.221403:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.221409:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.221440:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.221454:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 23 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752949.221468:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875643182671744:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752949.221570:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b88a6bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788752949.224909:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875643182671744:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752949.224943:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752949.225782:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752949.226006:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164816000 00000100:00100000:3.0:1788752949.226021:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164816000 00010000:00010000:3.0:1788752949.226078:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 24 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752949.226164:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:3.0:1788752949.226179:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+24:2361:x1875643164816000:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752949.226198:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752949.226205:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 24 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.226219:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 24 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.226260:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484900ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef7c expref: 24 pid: 5835 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.226290:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752949.226297:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.226308:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.226343:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.226398:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752949.226481:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+23:2361:x1875643164816000:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 304us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752949.226491:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00010000:00010000:0.0:1788752949.226591:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.226620:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752949.226771:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788752949.226994:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788752949.227177:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182671872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788752949.227263:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752949.227329:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b88bd20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752949.227446:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182671872 00000100:00100000:1.0:1788752949.227457:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182671872 00000100:00100000:1.0:1788752949.227587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788752949.227599:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875643182671872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788752949.227747:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1875643182671872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 151us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752949.227754:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788752949.227914:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182671872:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788752949.228647:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788752949.228977:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788752949.229097:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182672000:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788752949.229204:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752949.229418:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672000 00000100:00100000:0.0:1788752949.229430:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672000 00000100:00100000:0.0:1788752949.229631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788752949.229643:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875643182672000:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788752949.230411:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1875643182672000:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 769us (1204us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788752949.230420:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788752949.230940:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788752949.231002:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182672000:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788752949.231116:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788752949.231440:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.231451:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.231458:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.231462:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752949.231466:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.231472:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.231502:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752949.231505:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788752949.231510:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.231515:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f4849013a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788752949.231740:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788752949.232006:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788752949.232019:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348965895611ns, next at 349965893443ns, rc = 0 00000001:00080000:3.0:1788752949.232027:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788752949.232904:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752949.232911:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788752949.232922:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490125 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efa6 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752949.233080:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+26:10300:x1875643164815872:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 12686us (12884us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788752949.233093:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000020:00080000:3.0:1788752949.233100:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788752949.235980:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752949.236093:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164816128 00000100:00100000:3.0:1788752949.236107:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164816128 00000100:00100000:0.0:1788752949.236466:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:0.0:1788752949.236481:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+26:10300:x1875643164816128:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752949.236518:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752949.236549:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efad expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.236639:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efad expref: 27 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.236656:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efad expref: 27 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.236719:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752949.236723:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788752949.236728:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8400, rc 0) 00000100:00100000:0.0:1788752949.236851:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+27:10300:x1875643164816128:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 373us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752949.236858:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:1.0:1788752949.240459:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.240605:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164816384 00000100:00100000:0.0:1788752949.240617:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164816384 00000100:00100000:0.0:1788752949.240742:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:0.0:1788752949.240755:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f778c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+27:10300:x1875643164816384:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752949.241108:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f778c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+28:10300:x1875643164816384:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 355us (657us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788752949.241116:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1788752949.303186:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.303375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164816640 00000100:00100000:0.0:1788752949.303388:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164816640 00000100:00100000:0.0:1788752949.303481:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:0.0:1788752949.303494:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+28:10310:x1875643164816640:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752949.303527:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752949.303553:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efb4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752949.303683:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788752949.303852:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490148 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efb4 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.303894:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:0.0:1788752949.303897:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788752949.303903:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efb4 expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.303921:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752949.304017:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+29:10310:x1875643164816640:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 525us (895us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788752949.304025:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:2.0:1788752949.309615:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752949.309704:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164816768 00000100:00100000:1.0:1788752949.309719:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164816768 00000100:00100000:1.0:1788752949.309800:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1788752949.309814:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+29:10310:x1875643164816768:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:1.0:1788752949.309925:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.309948:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.309979:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310002:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310010:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310017:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310169:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310178:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310203:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788752949.310259:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310276:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310283:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310291:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310297:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752949.310302:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310310:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310325:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:1.0:1788752949.310328:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752949.310335:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310342:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310357:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310371:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310378:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310384:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752949.310387:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310394:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310403:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba3667d00) 00010000:00010000:1.0:1788752949.310405:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752949.310408:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310414:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849015d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310431:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310447:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310453:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310459:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752949.310469:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310476:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310485:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752949.310488:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752949.310491:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.310497:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752949.310618:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+29:10310:x1875643164816768:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 804us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752949.310627:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:2.0:1788752949.313777:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752949.313932:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164817024 00000100:00100000:3.0:1788752949.313945:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164817024 00000100:00100000:3.0:1788752949.314067:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1788752949.314080:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+29:10310:x1875643164817024:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1788752949.314478:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+30:10310:x1875643164817024:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 400us (711us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788752949.314487:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1788752949.357042:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.357558:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164817280 00000100:00100000:0.0:1788752949.357624:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164817280 00000100:00100000:0.0:1788752949.357870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:0.0:1788752949.357883:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+30:10313:x1875643164817280:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752949.357918:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752949.357947:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849016b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efbb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358045:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358062:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358075:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358092:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358120:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358223:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358882:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358896:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.358906:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752949.358920:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788752949.359054:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359062:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359070:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359077:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752949.359082:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359090:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359153:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752949.359157:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752949.359163:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359170:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490172 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359187:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359194:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359200:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359205:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752949.359208:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359214:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359221:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752949.359223:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752949.359226:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359232:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359451:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849016b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359468:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.359476:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752949.359479:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752949.359482:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8000, rc 0) 00000100:00100000:0.0:1788752949.359910:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+32:10313:x1875643164817280:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2028us (2876us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788752949.359922:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:2.0:1788752949.363854:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.363982:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164817408 00000100:00100000:0.0:1788752949.363996:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164817408 00000100:00100000:0.0:1788752949.364114:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:0.0:1788752949.364162:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+32:10313:x1875643164817408:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1788752949.364251:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364271:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364296:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364477:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364509:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364517:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364524:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752949.364529:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364536:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364549:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752949.364552:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788752949.364558:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.364565:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849018e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752949.364684:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+32:10313:x1875643164817408:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 559us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752949.364707:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1788752949.369925:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.370242:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164817664 00000100:00100000:0.0:1788752949.370257:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164817664 00000100:00100000:0.0:1788752949.370405:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:0.0:1788752949.370421:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+32:10313:x1875643164817664:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752949.371993:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+33:10313:x1875643164817664:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 1567us (2070us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788752949.372026:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1788752949.418883:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182672384:0@lo:400:kworker.0 00000100:00100000:0.0:1788752949.418908:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182672512:0@lo:400:kworker.0 00000100:00100000:1.0:1788752949.419032:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182672256:0@lo:400:kworker.0 00000100:00100000:3.0:1788752949.419316:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182672128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752949.421416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752949.421416:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752949.421513:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788752949.421526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752949.421528:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182672896:0@lo:400:kworker.0 00000100:00100000:2.0:1788752949.421589:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672256 00000100:00100000:2.0:1788752949.421599:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672256 00000100:00100000:0.0:1788752949.421607:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752949.421655:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672512 00000100:00100000:0.0:1788752949.421660:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672512 00000100:00100000:0.0:1788752949.421728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672384 00000100:00100000:0.0:1788752949.421732:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672384 00000100:00100000:0.0:1788752949.421752:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788752949.421761:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182672512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752949.421839:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182672512:12345-0@lo:400:kworker.0 Request processed in 78us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752949.421847:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788752949.421865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788752949.421872:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182672384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752949.421908:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182672384:12345-0@lo:400:kworker.0 Request processed in 36us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752949.421915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788752949.421920:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788752949.421931:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3304:x1875643182672256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752949.421977:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3304:x1875643182672256:12345-0@lo:400:kworker.0 Request processed in 49us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752949.421985:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788752949.422186:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182672384:0@lo:400:kworker.0 00000100:00100000:3.0:1788752949.422323:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752949.422351:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182672640:0@lo:400:kworker.0 00000100:00100000:3.0:1788752949.422377:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752949.422551:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b577cb32-91f9-472d-9b00-c1edbc016b63:3304:1875643182672256:0@lo:400:kworker.0 00000100:00100000:1.0:1788752949.422560:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182672768:0@lo:400:kworker.0 00000100:00100000:1.0:1788752949.422586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752949.422836:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672128 00000100:00100000:2.0:1788752949.422842:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672128 00000100:00100000:2.0:1788752949.422928:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788752949.422936:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182672128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788752949.422960:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752949.423010:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182672128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752949.423016:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788752949.423087:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672896 00000100:00100000:3.0:1788752949.423093:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672896 00000100:00100000:3.0:1788752949.423146:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672640 00000100:00100000:3.0:1788752949.423150:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672640 00000100:00100000:3.0:1788752949.423174:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788752949.423182:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182672896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752949.423238:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182672896:12345-0@lo:400:kworker.0 Request processed in 56us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752949.423244:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788752949.423259:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788752949.423266:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182672640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752949.423294:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182672640:12345-0@lo:400:kworker.0 Request processed in 29us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752949.423300:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788752949.423350:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bdca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182672128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752949.423361:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182672640:0@lo:400:kworker.0 00000100:00080000:0.0:1788752949.426106:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752949.426200:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182672896:0@lo:400:kworker.0 00000100:00100000:0.0:1788752949.426221:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182672512:0@lo:400:kworker.0 00000100:00100000:0.0:1788752949.426275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182672768 00000100:00100000:0.0:1788752949.426283:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182672768 00000100:00100000:0.0:1788752949.426377:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788752949.426386:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182672768:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788752949.426447:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752949.426478:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182672768:12345-0@lo:400:kworker.0 Request processed in 91us (3889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752949.426486:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788752949.426496:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182672768:0@lo:400:kworker.0 00000100:00100000:3.0:1788752949.555172:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752949.555286:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752949.555332:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752949.555621:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164818048 00000100:00100000:1.0:1788752949.555634:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164818048 00000100:00100000:1.0:1788752949.555738:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:1.0:1788752949.555750:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164818048:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752949.555867:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164818048:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 119us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752949.555876:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:2.0:1788752949.557725:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164817920 00000100:00100000:2.0:1788752949.557744:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164817920 00000100:00100000:2.0:1788752949.557844:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:2.0:1788752949.557855:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2359:x1875643164817920:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:3.0:1788752949.557861:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752949.557954:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2359:x1875643164817920:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 100us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752949.557961:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:0.0:1788752949.558271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164817792 00000100:00100000:0.0:1788752949.558278:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164817792 00000100:00100000:0.0:1788752949.558323:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 279 00000100:00100000:0.0:1788752949.558334:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164817792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752949.558386:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164817792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 54us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752949.558392:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 279 00000100:00100000:3.0:1788752949.564030:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.564210:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164818304 00000100:00100000:0.0:1788752949.564224:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164818304 00000100:00100000:0.0:1788752949.564299:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:0.0:1788752949.564309:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+33:10344:x1875643164818304:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1788752949.564340:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752949.564365:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490195 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efc2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.564491:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849019c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.564506:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849019c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.564519:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849019c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752949.564555:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788752949.564746:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490195 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc2 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.564767:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849019c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc2 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.564778:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752949.564781:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752949.564784:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752949.564860:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+35:10344:x1875643164818304:12345-192.168.203.5@tcp:101:cat.0 Request processed in 552us (843us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788752949.564868:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:3.0:1788752949.568207:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752949.568406:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164818432 00000100:00100000:2.0:1788752949.568420:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164818432 00000100:00100000:2.0:1788752949.568504:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1788752949.568517:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+35:2359:x1875643164818432:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752949.568536:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752949.568569:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849019c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc2 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.568609:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:2.0:1788752949.568616:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752949.568700:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+34:2359:x1875643164818432:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 176us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752949.568708:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:3.0:1788752949.571007:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752949.571597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164818688 00000100:00100000:1.0:1788752949.571612:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164818688 00000100:00100000:1.0:1788752949.571700:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:1.0:1788752949.571714:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+34:10344:x1875643164818688:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:1.0:1788752949.572050:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+35:10344:x1875643164818688:12345-192.168.203.5@tcp:35:cat.0 Request processed in 337us (1051us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788752949.572058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1788752949.644005:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752949.644107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164818944 00000100:00100000:1.0:1788752949.644151:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164818944 00000100:00100000:1.0:1788752949.644240:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:1.0:1788752949.644252:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+35:10350:x1875643164818944:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:1.0:1788752949.644286:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752949.644290:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788752949.644325:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef98 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.644351:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:1.0:1788752949.644356:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752949.644374:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484901aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efc9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.644510:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.644551:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.644560:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.644600:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.644616:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 35 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752949.644631:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182673024:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752949.644783:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45840 going to sleep for 11 seconds 00000100:00100000:1.0:1788752949.649370:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182673024:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752949.649410:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752949.650255:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752949.650661:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164819072 00000100:00100000:2.0:1788752949.650674:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164819072 00010000:00010000:2.0:1788752949.650798:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 36 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752949.650892:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:2.0:1788752949.650903:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+36:2360:x1875643164819072:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752949.650922:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752949.650930:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 36 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.650944:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 36 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.650971:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490180 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efbb expref: 36 pid: 5832 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.650991:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:2.0:1788752949.650998:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.651031:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.651041:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.651168:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752949.651249:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+35:2360:x1875643164819072:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 336us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752949.651257:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00010000:00010000:3.0:1788752949.652112:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.652137:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752949.652167:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788752949.652910:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484901aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.652931:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752949.652938:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:3.0:1788752949.652941:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788752949.652943:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270600, rc 0) 00000100:00100000:3.0:1788752949.653014:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+35:10350:x1875643164818944:12345-192.168.203.5@tcp:101:dd.0 Request processed in 8762us (9034us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788752949.653022:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1788752949.655859:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.656048:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164819328 00000100:00100000:0.0:1788752949.656062:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164819328 00000100:00100000:0.0:1788752949.656173:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:0.0:1788752949.656185:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+35:10350:x1875643164819328:12345-192.168.203.5@tcp:36:dd.0 00010000:00010000:0.0:1788752949.656577:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.656604:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.656618:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752949.656702:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788752949.656743:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000f2dde091 reply state 00000000c1f96067 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752949.656753:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788752949.656873:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+38:10350:x1875643164819328:12345-192.168.203.5@tcp:36:dd.0 Request processed in 688us (1022us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788752949.656882:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000020:00080000:0.0:1788752949.656887:0:5835:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788752949.659948:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.659968:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.659977:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.659985:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752949.660074:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.660085:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.660109:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752949.660112:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752949.660119:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.660161:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484901bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752949.896222:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752949.896634:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164819456 00000100:00100000:2.0:1788752949.896644:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164819456 00000100:00100000:2.0:1788752949.896712:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:2.0:1788752949.896723:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+37:10364:x1875643164819456:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:2.0:1788752949.896745:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752949.896767:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484901c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efd0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.896836:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.896851:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.896862:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.896877:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.896901:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.896908:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.896997:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.897008:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.897017:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.897050:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.897063:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 38 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752949.897076:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182673152:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752949.897267:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b88a6b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788752949.904494:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752949.904728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164819712 00000100:00100000:2.0:1788752949.904737:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164819712 00000100:00100000:2.0:1788752949.904799:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1788752949.904810:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+39:5596:x1875643164819712:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788752949.905192:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+40:5596:x1875643164819712:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 382us (709us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788752949.905214:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1788752949.906224:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bddf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182673152:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752949.906254:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752949.907648:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752949.907744:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164819840 00000100:00100000:1.0:1788752949.907752:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164819840 00010000:00010000:1.0:1788752949.907789:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 40 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752949.907877:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:1.0:1788752949.907887:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+40:2359:x1875643164819840:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752949.907901:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752949.907908:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 40 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.907920:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 40 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.907956:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484901b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efc9 expref: 40 pid: 5834 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.907974:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752949.907979:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.907989:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.907997:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752949.908028:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752949.908078:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+39:2359:x1875643164819840:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 193us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752949.908086:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00010000:00010000:2.0:1788752949.908778:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908789:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752949.908831:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788752949.908835:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752949.908877:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908891:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908901:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908907:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908914:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908919:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752949.908923:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908930:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908954:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:2.0:1788752949.908957:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752949.908961:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908967:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484901cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908981:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908987:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908993:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.908998:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752949.909000:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.909006:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.909013:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b89426900) 00010000:00010000:2.0:1788752949.909015:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752949.909018:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.909024:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484901d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.909076:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484901c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd0 expref: 39 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.909090:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd0 expref: 38 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752949.909097:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:2.0:1788752949.909099:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752949.909102:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929a00, rc 0) 00000100:00100000:2.0:1788752949.909188:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+38:10364:x1875643164819456:12345-192.168.203.5@tcp:101:stat.0 Request processed in 12466us (12979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752949.909196:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:2.0:1788752949.989073:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752949.989162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164820096 00000100:00100000:0.0:1788752949.989171:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164820096 00000100:00100000:0.0:1788752949.989242:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:0.0:1788752949.989253:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+38:10370:x1875643164820096:12345-192.168.203.5@tcp:36:truncate.0 00010000:00010000:0.0:1788752949.989311:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752949.989349:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f484901db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd0 expref: 38 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.989372:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752949.989378:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788752949.989601:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.989614:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.989625:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752949.989680:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788752949.989729:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000c7ebe390 reply state 0000000062af375f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752949.990000:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788752949.990188:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+40:10370:x1875643164820096:12345-192.168.203.5@tcp:36:truncate.0 Request processed in 935us (1127us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788752949.990196:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000020:00080000:0.0:1788752949.990202:0:5835:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788752949.992998:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.993017:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.993026:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.993032:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752949.993036:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.993044:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.993060:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752949.993063:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752949.993068:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752949.993074:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484901e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752950.186391:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752950.213811:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752950.214058:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164820224 00000100:00100000:3.0:1788752950.214069:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164820224 00000100:00100000:3.0:1788752950.214162:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:3.0:1788752950.214174:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+39:10384:x1875643164820224:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:3.0:1788752950.214199:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752950.214220:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f484901e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efd7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214291:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214308:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214322:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214352:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214360:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214367:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214462:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214471:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214494:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752950.214538:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788752950.214544:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788752950.214568:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214580:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214603:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214610:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214616:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214623:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2ce00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752950.214627:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214635:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214647:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752950.214651:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752950.214655:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214672:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484901f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214699:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214705:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214711:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214716:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752950.214719:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214727:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214735:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba049d200) 00010000:00010000:3.0:1788752950.214737:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752950.214741:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.214747:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484901f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.215064:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f484901e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.215080:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752950.215095:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:3.0:1788752950.215098:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752950.215101:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d200, rc 0) 00000100:00100000:3.0:1788752950.215375:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+40:10384:x1875643164820224:12345-192.168.203.5@tcp:101:stat.0 Request processed in 1202us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752950.215384:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:3.0:1788752950.286429:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.286534:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164820480 00000100:00100000:0.0:1788752950.286564:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164820480 00000100:00100000:0.0:1788752950.286637:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:0.0:1788752950.286648:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+40:10394:x1875643164820480:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752950.286669:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752950.287162:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efde expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752950.287256:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788752950.288504:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490205 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efde expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.288524:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:0.0:1788752950.288527:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788752950.288533:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efde expref: 42 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.288548:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752950.288621:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+41:10394:x1875643164820480:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1974us (2202us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788752950.288629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:0.0:1788752950.295334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752950.295556:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164820736 00000100:00100000:2.0:1788752950.295567:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164820736 00000100:00100000:2.0:1788752950.295676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1788752950.295698:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+41:10394:x1875643164820736:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1788752950.295958:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+42:10394:x1875643164820736:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 272us (705us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788752950.295966:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1788752950.345427:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752950.345551:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164820992 00000100:00100000:1.0:1788752950.345568:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164820992 00000100:00100000:1.0:1788752950.345650:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:1.0:1788752950.345662:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+42:10400:x1875643164820992:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752950.345697:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752950.345717:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490213 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efe5 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.345835:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.345873:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.345881:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.346050:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.346065:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 43 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752950.346078:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182673280:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752950.346243:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45840 going to sleep for 11 seconds 00000100:00100000:1.0:1788752950.351605:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182673280:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752950.351649:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752950.352384:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752950.352541:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164821120 00000100:00100000:1.0:1788752950.352550:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164821120 00010000:00010000:1.0:1788752950.352598:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 44 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752950.352646:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1788752950.352657:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+44:2360:x1875643164821120:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752950.352677:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752950.352713:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 44 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.352728:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 44 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.352758:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484901fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efd7 expref: 44 pid: 5834 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.352778:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752950.352783:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.352806:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.352815:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.352854:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752950.352937:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+43:2360:x1875643164821120:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 281us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752950.352946:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00010000:00010000:0.0:1788752950.353563:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.353582:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752950.353612:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788752950.353834:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490213 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 44 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.353869:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 43 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.353890:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752950.353894:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788752950.353897:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271800, rc 0) 00000100:00100000:0.0:1788752950.353953:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+43:10400:x1875643164820992:12345-192.168.203.5@tcp:101:bash.0 Request processed in 8294us (8540us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788752950.353962:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:3.0:1788752950.359683:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752950.359832:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164821376 00000100:00100000:2.0:1788752950.359846:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164821376 00000100:00100000:2.0:1788752950.359988:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:2.0:1788752950.360023:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+43:10400:x1875643164821376:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:2.0:1788752950.360861:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752950.360960:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752950.360977:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788752950.361039:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788752950.361075:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000002753c941 reply state 000000006a82abd4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752950.361085:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752950.361661:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+46:10400:x1875643164821376:12345-192.168.203.5@tcp:36:bash.0 Request processed in 1638us (1986us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788752950.361671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00000020:00080000:2.0:1788752950.361677:0:5832:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788752950.366415:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.366436:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.366446:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.366479:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752950.366485:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.366495:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.366516:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752950.366519:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752950.366526:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.366531:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f48490228 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752950.368100:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752950.368289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164821504 00000100:00100000:1.0:1788752950.368305:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164821504 00000100:00100000:1.0:1788752950.368376:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:1.0:1788752950.368389:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+45:10400:x1875643164821504:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752950.368422:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752950.368448:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849022f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852efec expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.368557:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.368576:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 46 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.368609:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.368651:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 46 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.368669:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 46 pid: 7899 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752950.368698:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182673408:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752950.368808:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45840 going to sleep for 11 seconds 00000100:00100000:1.0:1788752950.371268:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182673408:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752950.371309:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752950.371828:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.371926:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164821632 00000100:00100000:0.0:1788752950.371938:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164821632 00010000:00010000:0.0:1788752950.371986:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 47 pid: 7899 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752950.372033:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:0.0:1788752950.372043:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+47:2361:x1875643164821632:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752950.372061:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752950.372070:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 47 pid: 7899 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.372085:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 47 pid: 7899 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.372245:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849021a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852efe5 expref: 47 pid: 7899 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.372293:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752950.372299:0:11152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.372309:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.372318:0:11152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.372355:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752950.372432:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+46:2361:x1875643164821632:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 390us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752950.372440:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00010000:00010000:1.0:1788752950.373179:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.373194:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752950.373261:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788752950.373267:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752950.373293:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.373338:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849022f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efec expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.373379:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efec expref: 45 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.373389:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752950.373392:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752950.373395:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271600, rc 0) 00000100:00100000:1.0:1788752950.373450:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+45:10400:x1875643164821504:12345-192.168.203.5@tcp:101:bash.0 Request processed in 5063us (5360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752950.373460:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:3.0:1788752950.377715:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.377862:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164821888 00000100:00100000:0.0:1788752950.377876:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164821888 00000100:00100000:0.0:1788752950.378010:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:0.0:1788752950.378022:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f779850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+45:10400:x1875643164821888:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:0.0:1788752950.378795:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f779850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+46:10400:x1875643164821888:12345-192.168.203.5@tcp:35:bash.0 Request processed in 771us (1674us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788752950.378807:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:3.0:1788752950.455756:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.455896:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164822144 00000100:00100000:0.0:1788752950.455910:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164822144 00000100:00100000:0.0:1788752950.455986:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:0.0:1788752950.455999:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+46:10410:x1875643164822144:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752950.456032:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752950.456070:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849023d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852eff3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752950.456236:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788752950.456424:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849023d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eff3 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.456442:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:0.0:1788752950.456445:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788752950.456452:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849023d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eff3 expref: 48 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.456470:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752950.456555:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7493b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+47:10410:x1875643164822144:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 558us (810us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788752950.456564:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:3.0:1788752950.459836:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.459943:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164822272 00000100:00100000:0.0:1788752950.459956:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164822272 00000100:00100000:0.0:1788752950.460031:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:0.0:1788752950.460044:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+47:10410:x1875643164822272:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:0.0:1788752950.460175:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460199:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460214:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460256:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460263:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460271:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460405:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460415:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460422:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752950.460475:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460489:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460496:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460504:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460510:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752950.460514:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460530:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460546:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752950.460549:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752950.460555:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460563:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849024b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460579:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460586:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460592:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460597:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752950.460600:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460606:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460613:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752950.460615:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752950.460618:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460634:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490252 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460651:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460657:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460663:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460668:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752950.460670:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460677:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460694:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752950.460697:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752950.460701:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.460707:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752950.460803:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+47:10410:x1875643164822272:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 761us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752950.460811:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:3.0:1788752950.463356:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.463469:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164822528 00000100:00100000:0.0:1788752950.463481:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164822528 00000100:00100000:0.0:1788752950.463552:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1788752950.463563:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+47:10410:x1875643164822528:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752950.463879:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+48:10410:x1875643164822528:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 316us (532us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788752950.463887:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1788752950.494474:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.494656:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164822784 00000100:00100000:0.0:1788752950.494669:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164822784 00000100:00100000:0.0:1788752950.494746:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:0.0:1788752950.494758:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+48:10413:x1875643164822784:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752950.494792:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752950.494818:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852effa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.494913:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.494932:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.494945:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.494960:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.494967:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.494995:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495185:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495195:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495203:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752950.495214:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788752950.495353:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495362:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495369:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495376:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752950.495381:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495390:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495405:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752950.495408:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752950.495423:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495430:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f48490267 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495445:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495452:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495458:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495463:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752950.495466:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495471:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495479:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752950.495481:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752950.495484:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495490:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849026e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495542:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852effa expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495569:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852effa expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.495577:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752950.495580:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752950.495583:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752950.495667:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+50:10413:x1875643164822784:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 909us (1203us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788752950.495676:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:3.0:1788752950.499519:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752950.499760:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164822912 00000100:00100000:1.0:1788752950.499773:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164822912 00000100:00100000:1.0:1788752950.499848:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:1.0:1788752950.499863:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+50:10413:x1875643164822912:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:1.0:1788752950.499951:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.499973:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.499989:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.500024:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.500032:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.500062:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.500069:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752950.500074:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.500083:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.500096:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752950.500100:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752950.500105:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.500112:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752950.500264:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+50:10413:x1875643164822912:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 403us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752950.500272:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:3.0:1788752950.501909:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752950.501989:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.502144:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164823296 00000100:00100000:1.0:1788752950.502148:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164823040 00000100:00100000:1.0:1788752950.502157:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164823040 00000100:00100000:0.0:1788752950.502157:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164823296 00000100:00100000:1.0:1788752950.502239:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:0.0:1788752950.502239:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:0.0:1788752950.502258:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+51:10413:x1875643164823296:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1788752950.502259:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+51:2360:x1875643164823040:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752950.502283:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752950.502318:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852effa expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.502365:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752950.502371:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752950.502445:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+50:2360:x1875643164823040:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 194us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752950.502454:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:0.0:1788752950.502873:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+50:10413:x1875643164823296:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 620us (881us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788752950.502881:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:3.0:1788752950.623071:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.623240:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164823552 00000100:00100000:0.0:1788752950.623254:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164823552 00000100:00100000:0.0:1788752950.623457:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:0.0:1788752950.623471:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+50:10432:x1875643164823552:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1788752950.623507:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752950.623534:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849028a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f001 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.625080:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490291 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.625137:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.625156:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490291 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752950.625180:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788752950.626231:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849028a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f001 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.626283:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490291 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f001 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.626296:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752950.626299:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788752950.626305:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9800, rc 0) 00000100:00100000:0.0:1788752950.626433:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+52:10432:x1875643164823552:12345-192.168.203.5@tcp:101:cat.0 Request processed in 2963us (3372us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788752950.626444:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:2.0:1788752950.664736:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.664846:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164823680 00000100:00100000:0.0:1788752950.664861:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164823680 00000100:00100000:0.0:1788752950.665001:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:0.0:1788752950.665015:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+52:10433:x1875643164823680:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752950.665054:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752950.665084:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849029f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f008 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.665264:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484902a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.665293:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484902a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.665308:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484902a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752950.665366:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788752950.665370:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752950.665391:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484902a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.665423:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849029f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f008 expref: 54 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.665449:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484902a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f008 expref: 53 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752950.665459:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752950.665463:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788752950.665467:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9000, rc 0) 00000100:00100000:0.0:1788752950.665555:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+53:10433:x1875643164823680:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 542us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752950.665562:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:1.0:1788752950.676084:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752950.676466:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164824064 00000100:00100000:0.0:1788752950.676480:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164824064 00000100:00100000:0.0:1788752950.676592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:0.0:1788752950.676604:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+53:10433:x1875643164824064:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752950.677899:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+54:10433:x1875643164824064:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 1289us (1817us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788752950.677912:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1788752950.680252:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752950.680379:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164824192 00000100:00100000:1.0:1788752950.680396:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164824192 00000100:00100000:1.0:1788752950.680481:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:1.0:1788752950.680492:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+54:10433:x1875643164824192:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:1.0:1788752950.680513:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788752950.680550:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490236 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efec expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.680577:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490291 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f001 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.680591:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852efad expref: 52 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.680604:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:1.0:1788752950.680618:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752950.680696:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+51:10433:x1875643164824192:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 206us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752950.680712:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:3.0:1788752950.686220:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752950.689531:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164824320 00000100:00100000:2.0:1788752950.689551:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164824320 00000100:00100000:2.0:1788752950.689645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:2.0:1788752950.689659:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+51:10433:x1875643164824320:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:2.0:1788752950.689833:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752950.689855:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752950.689871:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788752950.690296:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788752950.690519:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788752950.690614:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788752950.690823:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7492d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+51:10433:x1875643164824320:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1159us (4692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752950.690836:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:3.0:1788752950.718215:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752950.718339:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164824448 00000100:00100000:1.0:1788752950.718353:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164824448 00000100:00100000:1.0:1788752950.718434:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:1.0:1788752950.718457:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+51:10435:x1875643164824448:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752950.718485:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752950.718514:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f484902b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f00f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.718610:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.718866:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.718882:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.718902:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.718908:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.718914:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719048:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719058:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719090:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752950.719191:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788752950.719196:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752950.719221:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719236:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719246:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719254:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719261:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719269:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752950.719273:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719283:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719297:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:1.0:1788752950.719301:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752950.719308:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719328:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719346:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719352:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719357:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719363:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752950.719366:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719373:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719382:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba3667d00) 00010000:00010000:1.0:1788752950.719385:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752950.719387:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.719394:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484902c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.720048:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f484902b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 53 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.720065:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 52 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752950.720082:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426900) 00010000:00010000:1.0:1788752950.720085:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788752950.720088:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271e00, rc 0) 00000100:00100000:1.0:1788752950.720310:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+52:10435:x1875643164824448:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1854us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752950.720321:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00010000:00010000:1.0:1788752951.210294:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788752951.432290:0:11987:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752951.432301:0:11987:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752951.432338:0:11987:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788752951.432345:0:11987:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788752951.595395:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788752951.595407:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788752951.595460:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788752951.595470:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788752951.595625:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba7490700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182673536:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788752951.595733:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba012f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752951.606561:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.606632:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164824576 00000100:00100000:1.0:1788752951.606641:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164824576 00000100:00100000:1.0:1788752951.606713:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:1.0:1788752951.606726:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164824576:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788752951.606806:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164824576:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 Request processed in 84us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.606812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:0.0:1788752951.606904:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba7490700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182673536:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1788752951.607066:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752951.612772:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.613251:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164824704 00000100:00100000:2.0:1788752951.613261:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164824704 00000100:00100000:2.0:1788752951.613320:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:2.0:1788752951.613330:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+52:10447:x1875643164824704:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788752951.613361:0:5835:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788752951.613470:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+52:10447:x1875643164824704:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 141us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752951.613478:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:3.0:1788752951.626450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752951.627604:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164824832 00000100:00100000:0.0:1788752951.627617:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164824832 00000100:00100000:0.0:1788752951.627744:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1788752951.627757:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+52:10447:x1875643164824832:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788752951.627832:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627851:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627864:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627880:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627887:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627907:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627937:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627945:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.627951:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752951.627990:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788752951.627994:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752951.628011:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628023:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628030:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628037:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628043:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752951.628047:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628053:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628084:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:0.0:1788752951.628088:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752951.628094:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628100:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484902d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628114:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628144:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628151:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628156:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752951.628159:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628165:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628173:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752951.628175:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752951.628178:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628183:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484902d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628209:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628215:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628220:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628225:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752951.628227:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628232:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628239:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426900) 00010000:00010000:0.0:1788752951.628241:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752951.628244:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.628249:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484902de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752951.628343:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+52:10447:x1875643164824832:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 588us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752951.628351:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:3.0:1788752951.631392:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.631565:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164825088 00000100:00100000:1.0:1788752951.631583:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164825088 00000100:00100000:1.0:1788752951.631642:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:1.0:1788752951.631652:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+52:10447:x1875643164825088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752951.631671:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752951.631701:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484902e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f016 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631797:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631810:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631835:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752951.631849:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788752951.631945:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631952:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631958:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631963:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752951.631967:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631974:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426900) 00010000:00010000:1.0:1788752951.631988:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788752951.631993:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.631999:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f484902ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.632042:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484902e5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f016 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.632212:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:1.0:1788752951.632215:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752951.632221:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484902e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f016 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.632231:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270800, rc 0) 00000100:00100000:1.0:1788752951.632331:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164825088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 679us (949us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788752951.632338:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:3.0:1788752951.636089:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.636178:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164825216 00000100:00100000:1.0:1788752951.636189:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164825216 00000100:00100000:1.0:1788752951.636243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:1.0:1788752951.636253:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164825216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788752951.636305:0:5834:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788752951.636836:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164825216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 582us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.636845:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:3.0:1788752951.641742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.641843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164825472 00000100:00100000:2.0:1788752951.641852:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164825472 00000100:00100000:2.0:1788752951.641933:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:2.0:1788752951.641945:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164825472:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752951.641967:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752951.641970:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788752951.641995:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484902a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f008 expref: 53 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.642014:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:2.0:1788752951.642020:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752951.642032:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484902fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f01d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788752951.642689:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788752951.642881:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.642895:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.642904:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.642959:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484902fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f01d expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.642975:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f01d expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.642983:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b89426200) 00010000:00010000:2.0:1788752951.642986:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752951.642988:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929a00, rc 0) 00000100:00100000:2.0:1788752951.643107:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+54:10447:x1875643164825472:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1163us (1376us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788752951.643115:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:0.0:1788752951.647093:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752951.647502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164825728 00000100:00100000:3.0:1788752951.647513:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164825728 00000100:00100000:3.0:1788752951.647572:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:3.0:1788752951.647583:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+54:10447:x1875643164825728:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752951.647637:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752951.647664:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f01d expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647695:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b89426200) 00010000:00010000:3.0:1788752951.647706:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752951.647727:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647740:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647749:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647762:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647783:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647790:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647852:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647859:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647864:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647870:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752951.647875:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647882:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647890:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752951.647892:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752951.647896:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647901:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849030f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647910:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647922:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647928:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647932:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2cc00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752951.647935:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647941:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647947:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x668c2ffa (ffff9c9ba049d200) 00010000:00010000:3.0:1788752951.647950:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752951.647952:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.647957:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f48490316 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x668c2ffa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752951.648039:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164825728:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 457us (958us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788752951.648045:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:3.0:1788752951.659213:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752951.659316:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164825856 00000100:00100000:0.0:1788752951.659327:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164825856 00000100:00100000:0.0:1788752951.659407:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:0.0:1788752951.659416:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+53:10447:x1875643164825856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752951.659436:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752951.659458:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849031d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f024 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.659492:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.659505:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.659516:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.659603:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849031d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 55 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.659621:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 54 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.659630:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752951.659633:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788752951.659636:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9800, rc 0) 00000100:00100000:0.0:1788752951.659703:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+54:10447:x1875643164825856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 288us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752951.659710:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:0.0:1788752951.666195:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752951.666282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164826112 00000100:00100000:3.0:1788752951.666292:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164826112 00000100:00100000:3.0:1788752951.666946:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:3.0:1788752951.666959:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+54:10447:x1875643164826112:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752951.667058:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.667075:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.667088:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788752951.667454:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788752951.667466:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351401342405ns, next at 352401340039ns, rc = 0 00000004:00010000:3.0:1788752951.667554:0:5834:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001540f98e reply state 000000007b173f8f transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752951.667564:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788752951.667675:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+56:10447:x1875643164826112:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 719us (1491us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788752951.667694:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00010000:00010000:0.0:1788752951.673856:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.673893:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.673900:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.673906:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2cc00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752951.673911:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.673919:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.673938:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752951.673941:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788752951.673946:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.673952:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849032b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752951.675546:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.675617:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164826240 00000100:00100000:1.0:1788752951.675626:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164826240 00000100:00100000:1.0:1788752951.675689:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:1.0:1788752951.675699:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+55:10447:x1875643164826240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752951.675724:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752951.675741:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f02b expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.675817:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 56 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.675830:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 56 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.675847:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:1.0:1788752951.675850:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788752951.675853:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270800, rc 0) 00000100:00100000:1.0:1788752951.675909:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+56:10447:x1875643164826240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 211us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.675915:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:3.0:1788752951.679818:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752951.680200:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164826368 00000100:00100000:0.0:1788752951.680212:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164826368 00000100:00100000:0.0:1788752951.680262:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:0.0:1788752951.680280:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875643164826368:12345-192.168.203.5@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788752951.680319:0:6690:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp t0 exp 0000000000000000 cur 351 last 0 00000020:00000080:0.0:1788752951.680365:0:6690:0:(genops.c:1384:class_connect()) connect: client 240b527c-392e-42d3-b78c-b594aea00353, cookie 0x80c8383f48490339 00002000:00100000:0.0:1788752951.680377:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 240b527c-392e-42d3-b78c-b594aea00353/ffff9c9b9192e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788752951.680634:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788752951.680875:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788752951.680908:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9c9b91928800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788752951.681016:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2357:x1875643164826368:12345-192.168.203.5@tcp:8:lhsmtool_posix.0 Request processed in 743us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752951.681024:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:0.0:1788752951.683747:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.683822:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164826496 00000100:00100000:2.0:1788752951.683831:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164826496 00000100:00100000:2.0:1788752951.683892:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:2.0:1788752951.683902:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+6:0:x1875643164826496:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788752951.684218:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788752951.710443:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000001:00080000:1.0:1788752951.710464:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1788752951.715009:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:0:x1875643164826496:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 31095us (31259us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788752951.715023:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:3.0:1788752951.720025:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.720098:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164826752 00000100:00100000:2.0:1788752951.720115:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164826752 00000100:00100000:2.0:1788752951.720349:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:2.0:1788752951.720621:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+56:10447:x1875643164826752:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788752951.720880:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+57:10447:x1875643164826752:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 521us (863us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788752951.720888:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1788752951.723548:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.724496:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164827008 00000100:00100000:2.0:1788752951.724509:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164827008 00000100:00100000:2.0:1788752951.724721:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:2.0:1788752951.724733:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+57:10447:x1875643164827008:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788752951.724839:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+57:10447:x1875643164827008:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 108us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752951.724847:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:3.0:1788752951.727663:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.727833:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164827136 00000100:00100000:1.0:1788752951.727843:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164827136 00000100:00100000:1.0:1788752951.727905:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:1.0:1788752951.727914:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+57:10447:x1875643164827136:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752951.727935:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752951.727956:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490340 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f032 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.728061:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.728074:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.728086:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752951.728177:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752951.728196:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.728222:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490340 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f032 expref: 59 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.728240:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f032 expref: 58 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.728248:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:1.0:1788752951.728251:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788752951.728255:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271200, rc 0) 00000100:00100000:1.0:1788752951.728316:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+58:10447:x1875643164827136:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 402us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.728323:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:0.0:1788752951.736915:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.737025:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164827264 00000100:00100000:1.0:1788752951.737034:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164827264 00000100:00100000:1.0:1788752951.737378:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:1.0:1788752951.737390:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+5:2360:x1875643164827264:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752951.737420:0:9256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752951.737442:0:9256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f039 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788752951.737471:0:9256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e3438, blocks: 0x1 00010000:00010000:1.0:1788752951.737491:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1788752951.737496:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752951.737505:0:9256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 6 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.737525:0:9256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 6 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.737539:0:9256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270600, rc 0) 00000100:00100000:1.0:1788752951.737774:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164827264:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 385us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.737781:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:3.0:1788752951.745341:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.745504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164827520 00000100:00100000:1.0:1788752951.745514:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164827520 00000100:00100000:1.0:1788752951.745607:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1788752951.745619:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+58:10447:x1875643164827520:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788752951.745753:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+58:10447:x1875643164827520:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 136us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.745762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:3.0:1788752951.750621:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752951.750816:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164827648 00000100:00100000:0.0:1788752951.750826:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164827648 00000100:00100000:0.0:1788752951.750889:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:0.0:1788752951.750899:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:10447:x1875643164827648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752951.750920:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752951.750942:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f040 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.750974:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 7 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.750983:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752951.750988:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752951.750992:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.751023:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 7 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.751057:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 7 pid: 9256 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752951.751080:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875643182673664:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752951.751194:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752951.755062:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf56a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875643182673664:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752951.755147:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.755168:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:1.0:1788752951.755230:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:10447:x1875643164827648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 4332us (4621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.755239:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:3.0:1788752951.756239:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.756580:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164827776 00000100:00100000:1.0:1788752951.756589:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164827776 00010000:00010000:1.0:1788752951.756626:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 7 pid: 9256 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.756664:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:1.0:1788752951.756673:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164827776:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752951.756694:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752951.756717:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 7 pid: 9256 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.756730:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 7 pid: 9256 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.756751:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849034e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f039 expref: 7 pid: 9256 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.756769:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752951.756785:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752951.756794:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.756804:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.756841:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.756855:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875643182673792:192.168.203.5@tcp:105: 00000100:00100000:1.0:1788752951.756926:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752951.759729:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875643182673792:192.168.203.5@tcp:105: 00010000:00010000:1.0:1788752951.759757:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752951.759812:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164827776:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 3139us (3578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.759823:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:0.0:1788752951.771768:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.771875:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164827904 00000100:00100000:1.0:1788752951.771885:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164827904 00002000:00100000:1.0:1788752951.771941:0:6696:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c9bbdf54380 x1875643164827904/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:167/0 lens 504/0 e 0 to 0 dl 1788752962 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788752951.771951:0:6696:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbdf54380 with x1875643164827904 ext(0->8) 00002000:00010000:1.0:1788752951.771957:0:6696:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbdf54380 00000100:00100000:1.0:1788752951.771995:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1788752951.772004:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164827904:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788752951.772643:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:240b527c-392e-42d3-b78c-b594aea00353+8:2360:x1875643164827904:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 637us (885us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788752951.772650:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00002000:00100000:1.0:1788752951.772658:0:6696:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c9bbdf54380 x1875643164827904/t4294967302(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:167/0 lens 504/448 e 0 to 0 dl 1788752962 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788752951.772666:0:6696:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbdf54380 with x1875643164827904 ext(0->8) 00002000:00010000:1.0:1788752951.772669:0:6696:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbdf54380 00000100:00100000:3.0:1788752951.779977:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.780480:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164828032 00000100:00100000:1.0:1788752951.780490:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164828032 00000100:00100000:1.0:1788752951.780553:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:1.0:1788752951.780564:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+58:10447:x1875643164828032:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788752951.852939:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:2.0:1788752951.852993:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:2.0:1788752951.853008:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1788752951.853049:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788752951.853092:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788752951.853117:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9a8428fc00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788752951.853148:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9ba072d900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9baff61480 00000020:00080000:2.0:1788752951.853152:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9ba072d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9bb5aa0800 00000020:00080000:2.0:1788752951.853169:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788752951.853282:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788752951.853542:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788752951.853562:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182674048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788752951.853623:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752951.853697:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182674048 00000100:00100000:0.0:1788752951.853704:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182674048 00000100:00100000:0.0:1788752951.853759:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788752951.853769:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182674048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788752951.853795:0:6690:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788752951.853829:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9e3435, atime: 0x6a9e3435, ctime: 0x6a9e3435, blocks: 0x1 00010000:00010000:0.0:1788752951.853837:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.853852:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=351s v=(0 0) 00010000:00010000:0.0:1788752951.853856:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752951.853863:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.853878:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.853906:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.853914:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.853931:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788752951.854336:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+13:10447:x1875643164828032:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 73770us (74366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752951.854394:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1875643182674048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 627us (770us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788752951.854402:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788752951.854426:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788752951.854438:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752951.854444:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.854452:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752951.854456:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.854464:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.854481:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.854498:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849035c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752951.854515:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752951.854516:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752951.854518:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788752951.854550:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9bbdf56680/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788752951.854556:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182674048:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788752951.855055:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182673920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788752951.855095:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752951.855453:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182673920 00000100:00100000:1.0:1788752951.855460:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182673920 00000100:00100000:1.0:1788752951.855547:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788752951.855556:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182673920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788752951.855701:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788752951.855705:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788752952 00002000:00010000:1.0:1788752951.855707:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788752951.855709:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788752952 -> 1788752952 00002000:00010000:1.0:1788752951.855712:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788752951.855751:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182673920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (655us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788752951.855758:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788752951.855837:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9b88a97800/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788752951.855842:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182673920:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788752951.855875:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752951.861584:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:0.0:1788752951.861830:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.861914:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164828160 00000100:00100000:2.0:1788752951.861923:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164828160 00000100:00100000:2.0:1788752951.861971:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:2.0:1788752951.861981:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164828160:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788752951.898082:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1788752951.898106:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788752951.898394:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164828160:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 36309us (36459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752951.898406:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:0.0:1788752951.901778:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.901974:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164828416 00000100:00100000:2.0:1788752951.901986:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164828416 00000100:00100000:2.0:1788752951.902053:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:2.0:1788752951.902412:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+13:10447:x1875643164828416:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788752951.902473:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752951.902500:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f032 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.902518:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:2.0:1788752951.902523:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752951.902550:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.902564:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.902573:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788752951.902882:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000001a86efa3 reply state 000000004c81540d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.902908:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752951.903114:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+14:10447:x1875643164828416:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1051us (1346us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788752951.903158:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:2.0:1788752951.908716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:1.0:1788752951.908732:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.908762:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.908770:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.908777:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85929c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752951.908782:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.908789:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.908806:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:1.0:1788752951.908809:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752951.908814:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.908820:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490363 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752951.908910:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164828544 00000100:00100000:3.0:1788752951.908919:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164828544 00000100:00100000:3.0:1788752951.909003:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:3.0:1788752951.909014:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164828544:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788752951.909300:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788752951.909304:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788752952 -> 1788752950 00002000:00010000:3.0:1788752951.909307:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788752949 00002000:00010000:3.0:1788752951.909320:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788752952 -> 1788752950 00002000:00010000:3.0:1788752951.909322:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788752951.909398:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164828544:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 384us (692us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788752951.909406:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1788752951.919578:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.920497:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164828800 00000100:00100000:2.0:1788752951.920510:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164828800 00000100:00100000:2.0:1788752951.920583:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:2.0:1788752951.920594:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+13:10447:x1875643164828800:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788752951.920665:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.920693:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.920704:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.920739:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.920755:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 13 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.920770:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182674176:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752951.920870:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a857660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752951.924718:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.924841:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182674176:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752951.924883:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.924965:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164828928 00000100:00100000:1.0:1788752951.924973:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164828928 00010000:00010000:1.0:1788752951.925007:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.925044:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:1.0:1788752951.925053:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+14:2361:x1875643164828928:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752951.925066:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752951.925078:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.925090:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.925111:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f024 expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.925163:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:1.0:1788752951.925168:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.925177:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.925186:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.925204:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752951.925261:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+13:2361:x1875643164828928:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 208us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.925268:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00010000:00010000:2.0:1788752951.925469:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925476:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925505:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925512:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925518:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925524:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85929c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752951.925528:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925535:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925545:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:2.0:1788752951.925547:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788752951.925551:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.925556:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f4849036a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.925610:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+12:10447:x1875643164828800:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 5017us (6045us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788752951.925618:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:0.0:1788752951.929427:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.929531:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164829056 00000100:00100000:1.0:1788752951.929540:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164829056 00000100:00100000:1.0:1788752951.929666:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:1.0:1788752951.929684:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164829056:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788752951.929734:0:9256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.929773:0:9256:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.929840:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752951.929846:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788752951.929852:0:9256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.929888:0:9256:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.929903:0:9256:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 7 pid: 6691 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.929917:0:9256:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9256:1875643182674304:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752951.929995:0:9256:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752951.937028:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.937156:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164829184 00000100:00100000:2.0:1788752951.937166:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164829184 00010000:00010000:2.0:1788752951.937206:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 8 pid: 6691 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.937250:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:2.0:1788752951.937260:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164829184:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752951.937275:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752951.937296:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 8 pid: 6691 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.937311:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 8 pid: 6691 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.937337:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752951.937341:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752951.937348:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.937359:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.937397:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752951.937444:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164829184:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 186us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752951.937452:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00010000:00010000:1.0:1788752951.937589:0:9256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5eb205e/0x80c8383f48490355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f040 expref: 7 pid: 6691 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.937603:0:9256:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9256:1875643182674304:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752951.937621:0:9256:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937631:0:9256:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937644:0:9256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937666:0:9256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937684:0:9256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937692:0:9256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937698:0:9256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752951.937702:0:9256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937711:0:9256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937722:0:9256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.937730:0:9256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f48490371 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.937786:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164829056:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 8112us (8370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752951.937793:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:0.0:1788752951.941276:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.941414:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164829440 00000100:00100000:1.0:1788752951.941424:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164829440 00000100:00100000:1.0:1788752951.941479:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:1.0:1788752951.941489:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+12:10447:x1875643164829440:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788752951.941571:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.941587:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.941598:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.941822:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.941833:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.941842:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.941874:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.941903:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 13 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752951.941918:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182674432:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752951.942102:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752951.946737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752951.946951:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182674432:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752951.946979:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.947343:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164829568 00000100:00100000:2.0:1788752951.947351:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164829568 00010000:00010000:2.0:1788752951.947389:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.947428:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:2.0:1788752951.947437:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+14:2361:x1875643164829568:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752951.947451:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752951.947458:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.947470:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.947501:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490332 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f02b expref: 14 pid: 7899 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.947517:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:2.0:1788752951.947521:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.947530:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.947551:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.947588:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752951.947645:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+13:2361:x1875643164829568:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 208us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752951.947652:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00010000:00010000:1.0:1788752951.947886:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.947895:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788752951.948084:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788752951.948293:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788752951.948348:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788752951.948427:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875643182674560:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788752951.948479:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752951.948508:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788752951.949377:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182674560 00000100:00100000:2.0:1788752951.949386:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182674560 00000100:00100000:2.0:1788752951.949429:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788752951.949438:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1875643182674560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788752951.949522:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1875643182674560:12345-0@lo:1000:mdt00_001.0 Request processed in 84us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752951.949529:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788752951.949570:0:5834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788752951.949575:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9b88a97800, transno 4294967303 00000100:00100000:2.0:1788752951.949587:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb54b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875643182674560:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788752951.951007:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1788752951.951074:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875643182674688:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788752951.951376:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752951.951455:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a85766840 going to sleep for 11 seconds 00000100:00100000:0.0:1788752951.952489:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182674688 00000100:00100000:0.0:1788752951.952502:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182674688 00000100:00100000:0.0:1788752951.952618:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788752951.952629:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1875643182674688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788752951.952900:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1875643182674688:12345-0@lo:1000:mdt00_001.0 Request processed in 272us (1523us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788752951.952924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788752951.952999:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5834:1875643182674688:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788752951.953040:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953051:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953066:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953072:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752951.953077:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953084:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953099:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9b9424ba00) 00010000:00010000:2.0:1788752951.953103:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788752951.953108:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953114:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f4849037f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953188:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953195:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953201:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953206:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752951.953208:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953225:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953234:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426900) 00010000:00010000:2.0:1788752951.953237:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788752951.953240:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953245:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484902ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953274:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953288:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953297:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953564:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.953589:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 16 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.953602:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182674816:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752951.953671:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a85766840 going to sleep for 11 seconds 00000100:00100000:2.0:1788752951.957772:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752951.957829:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164829696 00000100:00100000:2.0:1788752951.957839:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164829696 00010000:00010000:2.0:1788752951.957885:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 17 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752951.957922:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:2.0:1788752951.957932:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+17:2361:x1875643164829696:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752951.957948:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752951.957955:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 17 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.957968:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 17 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.957991:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426900) 00010000:00010000:2.0:1788752951.957997:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.958006:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.958015:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.958034:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752951.958085:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+17:2361:x1875643164829696:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 153us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752951.958092:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00010000:00010000:3.0:1788752951.959497:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484902c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f00f expref: 16 pid: 5834 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752951.959519:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1efb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182674816:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752951.959544:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959553:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959559:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959602:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959608:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959615:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959621:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752951.959625:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959632:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959645:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426900) 00010000:00010000:3.0:1788752951.959649:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752951.959654:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959659:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f48490386 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959669:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959684:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959689:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959700:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752951.959703:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959709:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959717:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426900) 00010000:00010000:3.0:1788752951.959719:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788752951.959722:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752951.959728:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490378 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752951.960045:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+15:10447:x1875643164829440:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 18555us (18787us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788752951.960054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000020:00080000:3.0:1788752951.960059:0:5834:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788752951.962407:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788752951.962430:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788752951.962465:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788752951.962471:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788752951.964068:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752951.964167:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164829952 00000100:00100000:0.0:1788752951.964177:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164829952 00000100:00100000:0.0:1788752951.964231:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:0.0:1788752951.964240:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+15:10447:x1875643164829952:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788752951.965644:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788752951.965769:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788752951.965896:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.965912:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.965933:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.965943:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.965950:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.965956:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752951.965981:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788752951.966143:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+17:10447:x1875643164829952:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1881us (2061us total) trans 4294967362 rc 0/0 00010000:00010000:2.0:1788752951.966153:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788752951.966153:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00010000:00010000:2.0:1788752951.966159:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.966166:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271800 already unused, calling callback (ffffffffc14dd940) 00000020:00080000:1.0:1788752951.966167:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788752951.966170:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.966178:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.966191:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c9ba3667100) 00010000:00010000:2.0:1788752951.966195:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788752951.966200:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.966206:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f4849038d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752951.966224:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752951.966226:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752951.966227:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752952.234395:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788752953.257446:0:12040:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788752953.257456:0:12040:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788752953.257490:0:12040:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788752953.257496:0:12040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788752953.259918:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752953.415651:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.415738:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164830208 00000100:00100000:0.0:1788752953.415748:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164830208 00000100:00100000:0.0:1788752953.415819:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:0.0:1788752953.415831:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+17:10464:x1875643164830208:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752953.415856:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752953.415874:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f047 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.415970:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f4849039b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.415985:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f4849039b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.415999:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f4849039b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752953.416010:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788752953.416154:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f047 expref: 20 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.416172:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f4849039b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f047 expref: 19 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.416189:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752953.416192:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788752953.416196:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9000, rc 0) 00000100:00100000:0.0:1788752953.416251:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+19:10464:x1875643164830208:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 422us (612us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788752953.416274:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00080000:3.0:1788752953.416619:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752953.426322:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752953.428274:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164830336 00000100:00100000:2.0:1788752953.428290:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164830336 00000100:00100000:2.0:1788752953.428356:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:2.0:1788752953.428367:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+19:10464:x1875643164830336:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:2.0:1788752953.428444:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428472:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428484:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428502:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428508:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428514:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428760:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428769:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428775:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788752953.428814:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428828:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428834:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428851:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428856:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752953.428861:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428869:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428879:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:2.0:1788752953.428883:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752953.428887:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428892:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484903a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428905:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428912:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428917:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428922:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752953.428925:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428940:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428947:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b89426700) 00010000:00010000:2.0:1788752953.428949:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752953.428952:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428958:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484903b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428971:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428977:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428982:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428987:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752953.428989:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.428995:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.429002:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b89426b00) 00010000:00010000:2.0:1788752953.429004:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752953.429007:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.429021:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484903b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752953.429108:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+19:10464:x1875643164830336:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 740us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752953.429116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:2.0:1788752953.497639:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.497733:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164830592 00000100:00100000:0.0:1788752953.497742:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164830592 00000100:00100000:0.0:1788752953.497822:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:0.0:1788752953.497831:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+19:10467:x1875643164830592:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752953.497850:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752953.497868:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484903be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f04e expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.497932:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.497945:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.497955:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.497968:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.497975:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.497999:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498382:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498391:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498398:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752953.498407:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788752953.498482:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498489:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498496:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498502:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752953.498506:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498513:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498523:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752953.498525:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752953.498535:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498541:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484903c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498553:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498559:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498565:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498569:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752953.498572:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498578:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498584:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424b300) 00010000:00010000:0.0:1788752953.498586:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752953.498589:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498594:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498628:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484903be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 22 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498650:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 21 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.498657:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752953.498660:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752953.498662:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752953.498781:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+21:10467:x1875643164830592:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 950us (1152us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788752953.498789:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1788752953.503462:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752953.503555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164830720 00000100:00100000:1.0:1788752953.503565:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164830720 00000100:00100000:1.0:1788752953.503621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:1.0:1788752953.503631:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+21:10467:x1875643164830720:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:1.0:1788752953.503704:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503720:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503732:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503778:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503785:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503792:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503797:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752953.503801:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503807:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503818:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:1.0:1788752953.503821:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752953.503825:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.503832:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484903e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752953.503905:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+21:10467:x1875643164830720:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 275us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752953.503913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:3.0:1788752953.510441:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752953.510680:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164830976 00000100:00100000:2.0:1788752953.510691:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164830976 00000100:00100000:2.0:1788752953.510755:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:2.0:1788752953.510765:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f779450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+21:10467:x1875643164830976:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1788752953.510996:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f779450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+22:10467:x1875643164830976:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 231us (566us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788752953.511003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1788752953.515656:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182674944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752953.515745:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752953.517542:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182674944 00000100:00100000:2.0:1788752953.517558:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182674944 00000100:00100000:2.0:1788752953.517647:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788752953.517659:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182674944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788752953.517708:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752953.517797:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182674944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752953.517803:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788752953.517990:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe1ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182674944:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788752953.518345:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752953.571497:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.571599:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164831232 00000100:00100000:0.0:1788752953.571609:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164831232 00000100:00100000:0.0:1788752953.571677:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:0.0:1788752953.571687:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+22:9988:x1875643164831232:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1788752953.571711:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752953.571734:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484903e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f055 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.571840:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.571856:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 23 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.571865:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.571908:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 23 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.571922:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 23 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752953.571935:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182675072:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752953.572083:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe0936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752953.580248:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.580420:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbe07fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182675072:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752953.580449:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752953.580595:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164831360 00000100:00100000:2.0:1788752953.580603:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164831360 00010000:00010000:2.0:1788752953.580646:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 24 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752953.580695:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:2.0:1788752953.580705:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+24:2360:x1875643164831360:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752953.580719:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752953.580727:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 24 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.580740:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 24 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.580763:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484903d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f04e expref: 24 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.580778:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:2.0:1788752953.580784:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.580793:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.580800:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752953.580830:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752953.580886:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+23:2360:x1875643164831360:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 181us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752953.580894:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00010000:00010000:3.0:1788752953.581156:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.581165:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752953.581185:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788752953.581389:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484903e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.581405:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.581411:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752953.581414:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788752953.581416:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8e00, rc 0) 00000100:00100000:3.0:1788752953.581449:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+23:9988:x1875643164831232:12345-192.168.203.5@tcp:101:bash.0 Request processed in 9764us (9966us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788752953.581456:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:3.0:1788752953.588888:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752953.588978:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164831616 00000100:00100000:1.0:1788752953.589002:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164831616 00000100:00100000:1.0:1788752953.589057:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 89 00000100:00100000:1.0:1788752953.589068:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+23:9988:x1875643164831616:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:1.0:1788752953.589376:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.589394:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.589407:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788752953.589463:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788752953.589488:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000ddd9f41c reply state 0000000068ce0e2d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752953.589498:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788752953.589579:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788752953.589754:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+27:9988:x1875643164831616:12345-192.168.203.5@tcp:36:bash.0 Request processed in 686us (877us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788752953.589762:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 89 00000020:00080000:1.0:1788752953.589766:0:5832:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788752953.595538:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.595559:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.595568:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.595574:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752953.595579:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.595586:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.595603:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752953.595617:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752953.595624:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.595630:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f484903fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752953.595961:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752953.596041:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164831744 00000100:00100000:3.0:1788752953.596053:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164831744 00000100:00100000:3.0:1788752953.596117:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:3.0:1788752953.596165:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+26:9988:x1875643164831744:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1788752953.596189:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752953.596207:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f05c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.596266:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f05c expref: 27 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.596288:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f05c expref: 27 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.596320:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752953.596323:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752953.596326:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ce00, rc 0) 00000100:00100000:3.0:1788752953.596396:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+27:9988:x1875643164831744:12345-192.168.203.5@tcp:101:bash.0 Request processed in 233us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752953.596403:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:2.0:1788752953.599975:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752953.600069:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164831872 00000100:00100000:1.0:1788752953.600080:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164831872 00000100:00100000:1.0:1788752953.600189:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:1.0:1788752953.600199:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:9988:x1875643164831872:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752953.600219:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752953.600239:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f063 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788752953.600285:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e3436, atime: 0x6a9e3435, ctime: 0x6a9e3436, blocks: 0xb 00010000:00010000:1.0:1788752953.600315:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1788752953.600320:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752953.600329:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.600347:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.600372:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270600, rc 0) 00000100:00100000:1.0:1788752953.600421:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:9988:x1875643164831872:12345-192.168.203.5@tcp:101:bash.0 Request processed in 223us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752953.600429:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00080000:3.0:1788752953.600953:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788752953.603855:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752953.603992:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164832000 00000100:00100000:3.0:1788752953.604002:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164832000 00002000:00010000:3.0:1788752953.604043:0:6694:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788752953.604047:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbe551500 with x1875643164832000 ext(0->18446744073709551615) 00002000:00010000:3.0:1788752953.604059:0:6694:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbe551500. 00000100:00100000:3.0:1788752953.604093:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:3.0:1788752953.604103:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2359:x1875643164832000:12345-192.168.203.5@tcp:10:bash.0 00002000:00010000:3.0:1788752953.604427:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788752953.604431:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788752950 -> 1788752953 00002000:00010000:3.0:1788752953.604434:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788752949 -> 1788752949 00002000:00010000:3.0:1788752953.604436:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788752950 -> 1788752953 00002000:00010000:3.0:1788752953.604439:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788752953.604564:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2359:x1875643164832000:12345-192.168.203.5@tcp:10:bash.0 Request processed in 460us (718us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788752953.604577:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00002000:00010000:2.0:1788752953.604582:0:6694:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788752953.604584:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbe551500 with x1875643164832000 ext(0->18446744073709551615) 00002000:00010000:2.0:1788752953.604590:0:6694:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbe551500. 00000100:00100000:2.0:1788752953.685794:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752953.685917:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164832128 00000100:00100000:1.0:1788752953.685929:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164832128 00000100:00100000:1.0:1788752953.686024:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:1.0:1788752953.686035:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+27:10481:x1875643164832128:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:1.0:1788752953.686108:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686164:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686177:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686210:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686218:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686224:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686709:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686719:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686727:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788752953.686764:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686774:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686780:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686786:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686791:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752953.686795:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686808:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686819:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:1.0:1788752953.686822:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752953.686827:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686832:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686844:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686849:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686854:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686858:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752953.686861:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686866:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686872:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba3667c00) 00010000:00010000:1.0:1788752953.686874:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752953.686877:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686890:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686905:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686910:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686916:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686920:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752953.686923:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686929:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686936:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:1.0:1788752953.686938:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752953.686941:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.686947:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752953.687065:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+27:10481:x1875643164832128:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 1030us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752953.687075:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:1.0:1788752953.730480:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752953.730542:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164832384 00000100:00100000:3.0:1788752953.730552:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164832384 00000100:00100000:3.0:1788752953.730605:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:3.0:1788752953.730615:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+27:10484:x1875643164832384:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752953.730646:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752953.730679:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490427 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f06a expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.730745:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.730759:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.730770:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.730784:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.730792:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.730798:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731037:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f4849043c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731046:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f4849043c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731054:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f4849043c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752953.731064:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788752953.731187:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731195:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731203:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731209:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2cc00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752953.731213:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731221:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731232:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752953.731236:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752953.731240:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731258:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849042e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731270:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731276:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731283:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731288:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752953.731451:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731624:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731633:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba049d000) 00010000:00010000:3.0:1788752953.731636:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752953.731640:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731646:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731707:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490427 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f06a expref: 30 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731721:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f4849043c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f06a expref: 29 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.731727:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752953.731729:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788752953.731731:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80031a00, rc 0) 00000100:00100000:3.0:1788752953.731843:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+29:10484:x1875643164832384:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1228us (1373us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788752953.731851:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:2.0:1788752953.736085:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752953.736206:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164832512 00000100:00100000:3.0:1788752953.736215:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164832512 00000100:00100000:3.0:1788752953.736276:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:3.0:1788752953.736287:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+29:10484:x1875643164832512:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1788752953.736368:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.736386:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.736396:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.736430:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.736443:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 29 pid: 5835 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752953.736466:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182675200:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752953.736559:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752953.741637:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.741734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164832768 00000100:00100000:0.0:1788752953.741743:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164832768 00000100:00100000:0.0:1788752953.741807:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:0.0:1788752953.741828:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+30:5596:x1875643164832768:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788752953.742178:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+31:5596:x1875643164832768:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 361us (549us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788752953.742185:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:3.0:1788752953.742305:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182675200:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752953.742331:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752953.745969:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.748568:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164832896 00000100:00100000:0.0:1788752953.748586:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164832896 00010000:00010000:0.0:1788752953.748640:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 31 pid: 5835 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752953.748698:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:0.0:1788752953.748718:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+31:2360:x1875643164832896:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752953.749058:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752953.749069:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 31 pid: 5835 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.749083:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 31 pid: 5835 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.749144:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484903ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f055 expref: 31 pid: 5835 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.749160:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752953.749165:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.749174:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.749182:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.749215:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752953.749379:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.749389:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.749418:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.749436:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.749442:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.749448:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030600 already unused, calling callback (ffffffffc1f2c4f0) 00000100:00100000:0.0:1788752953.749468:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+30:2360:x1875643164832896:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 760us (3507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752953.749476:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00010000:00010000:3.0:1788752953.751075:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.751094:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.751110:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752953.751113:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788752953.751118:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.751223:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f4849044a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752953.751513:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe550e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+29:10484:x1875643164832512:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 15225us (15437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752953.751524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:2.0:1788752953.755675:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.755766:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164833152 00000100:00100000:0.0:1788752953.755777:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164833152 00000100:00100000:0.0:1788752953.755843:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1788752953.755853:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+29:10484:x1875643164833152:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752953.756085:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+30:10484:x1875643164833152:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 232us (430us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788752953.756093:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1788752953.881377:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752953.881486:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164833408 00000100:00100000:3.0:1788752953.881496:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164833408 00000100:00100000:3.0:1788752953.881559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:3.0:1788752953.881583:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+30:10495:x1875643164833408:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:3.0:1788752953.881609:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752953.881641:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f071 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882015:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882030:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882043:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882058:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882066:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882072:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882383:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490466 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882394:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882401:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490466 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752953.882412:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788752953.882705:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882724:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882731:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882738:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752953.882743:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882751:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882764:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752953.882767:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752953.882773:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882778:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490458 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882796:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882803:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882808:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882813:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752953.882823:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882830:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882838:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba049d000) 00010000:00010000:3.0:1788752953.882841:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752953.882844:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882850:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f4849045f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882902:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f071 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882917:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490466 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f071 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752953.882925:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752953.882928:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752953.882930:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d600, rc 0) 00000100:00100000:3.0:1788752953.883005:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe07fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+32:10495:x1875643164833408:12345-192.168.203.5@tcp:101:cat.0 Request processed in 1436us (1641us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788752953.883014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:2.0:1788752953.886786:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.886879:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164833664 00000100:00100000:0.0:1788752953.886889:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164833664 00000100:00100000:0.0:1788752953.886964:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:0.0:1788752953.886973:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+32:10495:x1875643164833664:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:0.0:1788752953.887232:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+33:10495:x1875643164833664:12345-192.168.203.5@tcp:35:cat.0 Request processed in 259us (464us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788752953.887239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:2.0:1788752953.914396:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752953.914597:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164833920 00000100:00100000:1.0:1788752953.914609:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164833920 00000100:00100000:1.0:1788752953.914678:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:1.0:1788752953.914689:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+33:10496:x1875643164833920:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:1.0:1788752953.914746:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788752953.914785:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490466 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f071 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f4849043c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f06a expref: 32 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914830:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f05c expref: 31 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914841:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:1.0:1788752953.914853:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752953.914874:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914888:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914898:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914912:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914918:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.914939:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915222:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915231:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915238:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788752953.915818:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788752953.915828:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353649704686ns, next at 354649702489ns, rc = 0 00010000:00010000:1.0:1788752953.915888:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915900:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915909:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915916:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915922:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915927:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915967:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788752953.915989:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.915996:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916002:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916008:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752953.916012:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916020:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916030:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667600) 00010000:00010000:1.0:1788752953.916034:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788752953.916038:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916045:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490482 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916063:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916069:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916075:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916088:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752953.916091:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916097:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916106:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:1.0:1788752953.916108:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752953.916111:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.916117:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490474 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788752953.916163:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000577252ba reply state 000000002fa6478a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752953.916171:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788752953.916250:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+32:10496:x1875643164833920:12345-192.168.203.5@tcp:36:rm.0 Request processed in 1561us (1864us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788752953.916259:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 95 00010000:00010000:0.0:1788752953.916731:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752953.916738:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.916745:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752953.916748:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.916755:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.916764:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c9ba3667600) 00010000:00010000:0.0:1788752953.916778:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788752953.916781:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.916786:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490489 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.916802:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752953.916803:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752953.916805:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752953.919756:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.919888:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.919896:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.919924:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752953.919929:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.919937:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.919957:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba3667c00) 00010000:00010000:1.0:1788752953.919960:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752953.919964:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752953.919971:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f4849047b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752953.976266:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.977477:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164834176 00000100:00100000:0.0:1788752953.977490:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164834176 00000100:00100000:0.0:1788752953.977560:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:0.0:1788752953.977571:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+31:10502:x1875643164834176:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1788752953.977610:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752953.977630:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490490 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f078 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.977759:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.977774:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.977785:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.977800:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.977808:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.977816:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788752953.978963:0:7899:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788752953.979183:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.979196:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.979207:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.979277:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.979285:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.979292:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.980887:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752953.980894:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.980903:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.980918:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752953.980922:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752953.980928:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.980934:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752953.980953:0:7899:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000d9fa238e reply state 00000000f0939a17 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752953.980964:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788752953.981016:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490490 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 34 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.981059:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 33 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.981067:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:0.0:1788752953.981070:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752953.981072:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8a00, rc 0) 00000100:00100000:0.0:1788752953.981200:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+34:10502:x1875643164834176:12345-192.168.203.5@tcp:101:bash.0 Request processed in 3629us (4954us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788752953.981209:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 96 00010000:00010000:0.0:1788752953.984185:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.984207:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.984215:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.984222:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752953.984226:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.984234:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.984261:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424b300) 00010000:00010000:0.0:1788752953.984265:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752953.984270:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.984301:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849049e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752953.994598:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752953.994688:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164834304 00000100:00100000:0.0:1788752953.994698:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164834304 00000100:00100000:0.0:1788752953.994777:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:0.0:1788752953.994788:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164834304:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1788752953.994807:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752953.994827:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f07f expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788752953.994855:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788752953.994877:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1788752953.994881:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752953.994890:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.994910:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752953.994923:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752953.994986:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164834304:12345-192.168.203.5@tcp:101:bash.0 Request processed in 199us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752953.994993:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00080000:3.0:1788752953.995074:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752954.001715:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752954.001813:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164834432 00000100:00100000:1.0:1788752954.001824:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164834432 00000100:00100000:1.0:1788752954.001888:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:1.0:1788752954.001898:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+8:10502:x1875643164834432:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752954.001916:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752954.001936:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f086 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.001967:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.001976:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752954.001980:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752954.001998:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.002033:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.002059:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 9 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752954.002072:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba7490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875643182675328:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752954.002195:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788752954.007834:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.007918:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164834560 00000100:00100000:3.0:1788752954.007928:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164834560 00010000:00010000:3.0:1788752954.007965:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 10 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.008021:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1788752954.008032:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+10:2361:x1875643164834560:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752954.008057:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752954.008080:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 10 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.008094:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 10 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.008117:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752954.008163:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752954.008172:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.008183:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.008228:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.008243:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875643182675456:192.168.203.5@tcp:105: 00010000:00010000:1.0:1788752954.008249:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484904b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f07f expref: 10 pid: 6690 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752954.008268:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba7490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875643182675328:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752954.008292:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 9 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.008303:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270800, rc 0) 00000100:00100000:3.0:1788752954.008324:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788752954.008337:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+9:10502:x1875643164834432:12345-192.168.203.5@tcp:101:bash.0 Request processed in 6439us (6632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752954.008346:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:3.0:1788752954.018941:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875643182675456:192.168.203.5@tcp:105: 00010000:00010000:3.0:1788752954.018985:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752954.020963:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164834560:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 12918us (13126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.020978:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:2.0:1788752954.023961:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.024242:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164834816 00000100:00100000:3.0:1788752954.024616:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164834816 00000100:00100000:3.0:1788752954.024741:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:3.0:1788752954.024764:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+33:10502:x1875643164834816:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:3.0:1788752954.025116:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+34:10502:x1875643164834816:12345-192.168.203.5@tcp:35:bash.0 Request processed in 354us (1166us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788752954.025205:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000040:00080000:1.0:1788752954.031870:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788752954.031881:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788752954.032000:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788752954.032007:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788752954.164333:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752954.164391:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.164526:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164834944 00000100:00100000:3.0:1788752954.164539:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164834944 00002000:00100000:3.0:1788752954.164602:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c9ba1561180 x1875643164834944/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:170/0 lens 504/0 e 0 to 0 dl 1788752965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788752954.164613:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9ba1561180 with x1875643164834944 ext(0->8) 00002000:00010000:3.0:1788752954.164629:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c9ba1561180 00000100:00100000:3.0:1788752954.164674:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:3.0:1788752954.164684:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164834944:12345-192.168.203.5@tcp:4:bash.0 00000100:00100000:0.0:1788752954.165412:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164835072 00000100:00100000:0.0:1788752954.165420:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164835072 00000100:00100000:0.0:1788752954.165466:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:0.0:1788752954.165474:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+11:2361:x1875643164835072:12345-192.168.203.5@tcp:16:kworker.0 00000100:00100000:3.0:1788752954.168534:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+11:2361:x1875643164834944:12345-192.168.203.5@tcp:4:bash.0 Request processed in 3833us (4125us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788752954.168553:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00002000:00100000:3.0:1788752954.168568:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c9ba1561180 x1875643164834944/t4294967302(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:170/0 lens 504/448 e 0 to 0 dl 1788752965 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788752954.168580:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9ba1561180 with x1875643164834944 ext(0->8) 00002000:00010000:3.0:1788752954.168602:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c9ba1561180 00000100:00100000:3.0:1788752954.168719:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752954.170395:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164835200 00000100:00100000:1.0:1788752954.170411:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164835200 00000100:00100000:1.0:1788752954.170459:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:1.0:1788752954.170469:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+34:10518:x1875643164835200:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752954.170493:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752954.170514:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484904c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f08d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.170580:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484904c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.170594:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484904c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.170607:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484904c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752954.170644:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788752954.170647:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752954.170674:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484904c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.170699:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f484904c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f08d expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.170716:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484904c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f08d expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.170724:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:1.0:1788752954.170727:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788752954.170739:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271200, rc 0) 00000100:00100000:1.0:1788752954.170795:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+35:10518:x1875643164835200:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 327us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752954.170802:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:2.0:1788752954.178844:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.180162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164835456 00000100:00100000:3.0:1788752954.180182:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164835456 00000100:00100000:3.0:1788752954.180261:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:3.0:1788752954.180274:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+35:10518:x1875643164835456:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752954.180307:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752954.180333:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f484904cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f094 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.180464:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484904d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.180480:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484904d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.180492:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484904d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752954.180505:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788752954.180670:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f484904cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f094 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.180692:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484904d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f094 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.180702:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:3.0:1788752954.180704:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752954.180708:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d200, rc 0) 00000100:00100000:3.0:1788752954.180803:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+37:10518:x1875643164835456:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 530us (1973us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788752954.180810:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:2.0:1788752954.186787:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.186856:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164835712 00000100:00100000:3.0:1788752954.186875:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164835712 00000100:00100000:3.0:1788752954.187482:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:3.0:1788752954.187497:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+37:10518:x1875643164835712:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752954.187531:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752954.187555:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484904e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f09b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.188104:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484904eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.188135:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484904eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.188148:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484904eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752954.188162:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788752954.188326:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484904e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f09b expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.188346:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484904eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f09b expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.188356:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:3.0:1788752954.188358:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788752954.188371:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d600, rc 0) 00000100:00100000:3.0:1788752954.189732:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+39:10518:x1875643164835712:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2223us (2945us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788752954.189747:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:2.0:1788752954.192587:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.192693:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164835840 00000100:00100000:3.0:1788752954.192710:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164835840 00000100:00100000:3.0:1788752954.192817:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1788752954.192842:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+39:2360:x1875643164835840:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752954.192864:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752954.192903:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484904d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f094 expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.192933:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:3.0:1788752954.192940:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752954.193006:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+38:2360:x1875643164835840:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 167us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.193014:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788752954.202424:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.202792:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164835968 00000100:00100000:3.0:1788752954.202806:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164835968 00000100:00100000:3.0:1788752954.202874:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:3.0:1788752954.202883:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+11:2359:x1875643164835968:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:3.0:1788752954.202934:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.202958:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.202991:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752954.202996:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752954.203002:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.203045:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.203062:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 11 pid: 6691 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.203079:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182675584:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752954.203225:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61480 going to sleep for 11 seconds 00000100:00100000:1.0:1788752954.210478:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182675584:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752954.210513:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752954.210684:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.210837:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164836096 00000100:00100000:3.0:1788752954.210845:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164836096 00010000:00010000:3.0:1788752954.210883:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 12 pid: 6691 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.210924:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:3.0:1788752954.210935:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+12:2360:x1875643164836096:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752954.210952:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788752954.210971:0:11152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788752954.210973:0:11152:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788752954 00002000:00010000:3.0:1788752954.210976:0:11152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788752954 00002000:00010000:3.0:1788752954.210984:0:11152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788752954.210991:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 12 pid: 6691 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.211003:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 12 pid: 6691 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.211027:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f484904ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f086 expref: 12 pid: 6691 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.211044:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752954.211049:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752954.211055:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.211065:0:11152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.211091:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752954.211109:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.211118:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.211166:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.211175:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+11:2360:x1875643164836096:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 242us (492us total) trans 0 rc 0/0 00010000:00010000:1.0:1788752954.211176:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.211184:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.211187:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00010000:00010000:1.0:1788752954.211191:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2cc00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752954.211195:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.211215:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.211228:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.211235:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b1074c5/0x80c8383f484904f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752954.211309:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+10:2359:x1875643164835968:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 8426us (8896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752954.211316:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:3.0:1788752954.217343:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752954.217497:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164836352 00000100:00100000:1.0:1788752954.217509:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164836352 00000100:00100000:1.0:1788752954.217576:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:1.0:1788752954.217586:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f77a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+38:10518:x1875643164836352:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:1.0:1788752954.217651:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484904eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f09b expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788752954.217917:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788752954.217966:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788752954.218315:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788752954.218373:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.218388:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 42 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.218411:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.218444:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 42 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.218459:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 42 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752954.218473:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba7490e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875643182675712:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752954.218569:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788752954.226338:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.226342:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba7490e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875643182675712:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752954.226373:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.227335:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164836480 00000100:00100000:3.0:1788752954.227345:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164836480 00010000:00010000:3.0:1788752954.227382:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 43 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.227433:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1788752954.227443:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+43:2361:x1875643164836480:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752954.227461:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752954.227468:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 43 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.227480:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 43 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.227502:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484904a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f078 expref: 43 pid: 7899 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.227517:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:3.0:1788752954.227522:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.227531:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.227538:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.227561:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752954.227610:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+42:2361:x1875643164836480:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 167us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.227618:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00010000:00010000:3.0:1788752954.227645:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.227669:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788752954.227792:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788752954.227989:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788752954.228101:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182675840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788752954.228231:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752954.228264:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61480 going to sleep for 11 seconds 00000100:00100000:2.0:1788752954.228534:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182675840 00000100:00100000:2.0:1788752954.228542:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182675840 00000100:00100000:2.0:1788752954.228642:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788752954.228651:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1875643182675840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788752954.228730:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1875643182675840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752954.228736:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788752954.228776:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182675840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788752954.231114:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788752954.231249:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1562680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182675968:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788752954.231312:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752954.231354:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a85766cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752954.232404:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182675968 00000100:00100000:1.0:1788752954.232415:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182675968 00000100:00100000:1.0:1788752954.232462:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788752954.232470:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1875643182675968:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788752954.232777:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5837:x1875643182675968:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 306us (1463us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788752954.232783:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788752954.232894:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1562680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182675968:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788752954.232963:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788752954.233005:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.233015:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.233022:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.233028:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752954.233033:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.233040:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.233060:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:2.0:1788752954.233063:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788752954.233068:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.233074:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490500 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788752954.233339:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788752954.233426:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788752954.233436:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353967312613ns, next at 354967310821ns, rc = 0 00000001:00080000:2.0:1788752954.233443:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788752954.233474:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b100) 00010000:00010000:2.0:1788752954.233477:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788752954.233484:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484904eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f09b expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752954.233598:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f77a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+45:10518:x1875643164836352:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 16013us (16268us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788752954.233606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000020:00080000:2.0:1788752954.233610:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788752954.233957:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752954.240800:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.240930:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164836608 00000100:00100000:0.0:1788752954.240941:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164836608 00000100:00100000:0.0:1788752954.241009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:0.0:1788752954.241021:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+45:10518:x1875643164836608:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752954.241045:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752954.241068:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0a2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.241154:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a2 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.241170:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a2 expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.241189:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752954.241192:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788752954.241196:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8e00, rc 0) 00000100:00100000:0.0:1788752954.241258:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+46:10518:x1875643164836608:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 240us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752954.241265:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 100 00000001:00080000:1.0:1788752954.252195:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:1.0:1788752954.252221:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788752954.252373:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164835072:12345-192.168.203.5@tcp:16:kworker.0 Request processed in 86891us (88048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.252384:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:2.0:1788752954.256109:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.256238:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164836864 00000100:00100000:3.0:1788752954.256249:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164836864 00000100:00100000:3.0:1788752954.256321:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:3.0:1788752954.256335:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+46:10518:x1875643164836864:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1788752954.256610:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+47:10518:x1875643164836864:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 277us (513us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788752954.256621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00010000:00010000:1.0:1788752954.282490:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752954.345741:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.345988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164836992 00000100:00100000:0.0:1788752954.346023:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164836992 00000100:00100000:0.0:1788752954.346188:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:0.0:1788752954.346200:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+47:10528:x1875643164836992:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:0.0:1788752954.346307:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346331:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346346:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346366:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346374:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346381:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346504:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346513:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346520:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752954.346581:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346612:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346619:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346627:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346634:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752954.346638:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346647:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346669:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752954.346673:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752954.346679:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346686:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849050e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346702:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346709:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346715:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346727:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752954.346730:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346736:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346745:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752954.346748:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752954.346751:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346757:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48490515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346773:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346780:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346785:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346790:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752954.346793:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346799:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346818:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752954.346820:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752954.346824:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.346830:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849051c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752954.346933:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+47:10528:x1875643164836992:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 733us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752954.346942:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:1.0:1788752954.388913:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.391525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164837248 00000100:00100000:0.0:1788752954.391546:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164837248 00000100:00100000:0.0:1788752954.392769:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:0.0:1788752954.392785:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+47:10531:x1875643164837248:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752954.392814:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752954.392842:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0a9 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.392945:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.392965:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.392981:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.393975:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394021:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394031:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394221:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394232:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394239:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752954.394264:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788752954.394445:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394454:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394462:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394469:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752954.394474:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394482:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394513:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752954.394516:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752954.394522:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394529:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849052a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394545:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394551:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394557:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394563:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752954.394578:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394586:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394594:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752954.394596:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752954.394600:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394606:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48490531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394685:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394703:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 49 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.394710:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752954.394712:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752954.394715:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8400, rc 0) 00000100:00100000:0.0:1788752954.394798:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+49:10531:x1875643164837248:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 2015us (5897us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788752954.394808:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 102 00000100:00100000:2.0:1788752954.403239:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.403492:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164837376 00000100:00100000:3.0:1788752954.403503:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164837376 00000100:00100000:3.0:1788752954.403572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:3.0:1788752954.403582:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+49:10531:x1875643164837376:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1788752954.403652:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.403684:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404184:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404214:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404219:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404224:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404227:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752954.404230:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404235:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404243:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752954.404245:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788752954.404248:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.404252:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490546 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.404401:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+49:10531:x1875643164837376:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 820us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.404408:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:1.0:1788752954.406799:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.406893:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164837632 00000100:00100000:3.0:1788752954.406929:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164837632 00000100:00100000:3.0:1788752954.407015:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:3.0:1788752954.407028:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+49:10531:x1875643164837632:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1788752954.407622:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+50:10531:x1875643164837632:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 594us (831us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788752954.407632:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:1.0:1788752954.462858:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.463248:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164837888 00000100:00100000:3.0:1788752954.463273:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164837888 00000100:00100000:3.0:1788752954.463361:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:3.0:1788752954.463375:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+50:10541:x1875643164837888:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1788752954.463406:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752954.463410:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788752954.463445:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f484904c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f08d expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.463470:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752954.463477:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752954.463494:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849054d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0b0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.463623:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.463641:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.463650:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.463723:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.463743:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 50 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.463761:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182676096:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752954.463895:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752954.470292:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.470561:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182676096:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752954.470610:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752954.470794:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164838016 00000100:00100000:1.0:1788752954.470822:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164838016 00010000:00010000:1.0:1788752954.470871:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 51 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752954.470913:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:1.0:1788752954.470925:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+51:2361:x1875643164838016:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752954.470945:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752954.470953:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 51 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.470966:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 51 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.470992:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f48490538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a9 expref: 51 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.471021:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:1.0:1788752954.471027:0:11152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.471038:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.471047:0:11152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.471078:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752954.471176:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+50:2361:x1875643164838016:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 251us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752954.471197:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00010000:00010000:3.0:1788752954.471494:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.471503:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752954.471532:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788752954.471809:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849054d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 51 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.471831:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 50 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.471840:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752954.471843:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788752954.471854:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ce00, rc 0) 00000100:00100000:3.0:1788752954.471905:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+50:10541:x1875643164837888:12345-192.168.203.5@tcp:101:bash.0 Request processed in 8533us (9058us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788752954.471913:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:2.0:1788752954.474376:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.474477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164838272 00000100:00100000:0.0:1788752954.474489:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164838272 00000100:00100000:0.0:1788752954.474558:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 105 00000100:00100000:0.0:1788752954.474583:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+50:10541:x1875643164838272:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:0.0:1788752954.476319:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.476348:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.476364:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752954.476437:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788752954.476467:0:5834:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000b3452229 reply state 00000000c4d09939 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752954.476494:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788752954.476642:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe551180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+53:10541:x1875643164838272:12345-192.168.203.5@tcp:36:bash.0 Request processed in 2069us (2271us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788752954.476651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 105 00000020:00080000:0.0:1788752954.476668:0:5834:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788752954.478759:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.478779:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.478788:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.478794:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752954.478800:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.478808:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.478828:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752954.478832:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752954.478838:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.478844:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490562 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752954.479711:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.480096:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164838400 00000100:00100000:3.0:1788752954.480109:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164838400 00000100:00100000:2.0:1788752954.480804:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:2.0:1788752954.480833:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+52:10541:x1875643164838400:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1788752954.480868:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752954.480895:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0b7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.481026:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.481044:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 53 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.481054:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.481100:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 53 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.481118:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 53 pid: 7899 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752954.481170:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1577800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182676224:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752954.481296:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a85766540 going to sleep for 11 seconds 00000100:00100000:1.0:1788752954.485243:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.485328:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164838528 00000100:00100000:3.0:1788752954.485341:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164838528 00010000:00010000:3.0:1788752954.485425:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 54 pid: 7899 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.485469:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:3.0:1788752954.485479:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+54:2360:x1875643164838528:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752954.485496:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752954.485503:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 54 pid: 7899 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.485517:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 54 pid: 7899 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.485543:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752954.485549:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.485561:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.485569:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.485590:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752954.485630:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490554 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b0 expref: 54 pid: 7899 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.485648:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+53:2360:x1875643164838528:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 169us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.485669:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:2.0:1788752954.485671:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1577800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182676224:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752954.485705:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.485728:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.485734:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752954.485840:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788752954.485846:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752954.485874:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.485914:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f48490569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.485933:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 52 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.485942:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:2.0:1788752954.485946:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752954.485950:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85929a00, rc 0) 00000100:00100000:2.0:1788752954.486062:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+52:10541:x1875643164838400:12345-192.168.203.5@tcp:101:bash.0 Request processed in 5233us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752954.486070:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:1.0:1788752954.490067:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752954.490285:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164838784 00000100:00100000:2.0:1788752954.490307:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164838784 00000100:00100000:2.0:1788752954.490392:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:2.0:1788752954.490414:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+52:10541:x1875643164838784:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:2.0:1788752954.490744:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+53:10541:x1875643164838784:12345-192.168.203.5@tcp:35:bash.0 Request processed in 340us (687us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788752954.490768:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:2.0:1788752954.540751:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182676352:0@lo:400:kworker.0 00000100:00100000:2.0:1788752954.540882:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752954.540949:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182676352 00000100:00100000:3.0:1788752954.540960:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182676352 00000100:00100000:3.0:1788752954.541024:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788752954.541056:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182676352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752954.541236:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182676608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752954.541287:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752954.541351:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182676608 00000100:00100000:0.0:1788752954.541355:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182676608 00000100:00100000:0.0:1788752954.541390:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788752954.541398:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182676608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752954.541420:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3855613952 00000100:00100000:0.0:1788752954.541461:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182676608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752954.541468:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788752954.541525:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182676480:0@lo:400:kworker.0 00000100:00100000:0.0:1788752954.541556:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752954.541695:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182676352:12345-0@lo:400:kworker.0 Request processed in 640us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.541706:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788752954.541731:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182676736:0@lo:400:kworker.0 00000100:00100000:3.0:1788752954.541757:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182676480 00000100:00100000:3.0:1788752954.541762:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182676480 00000100:00100000:1.0:1788752954.541771:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752954.541787:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182676992:0@lo:400:kworker.0 00000100:00100000:3.0:1788752954.541798:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182676736 00000100:00100000:3.0:1788752954.541803:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182676736 00000100:00100000:1.0:1788752954.541819:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788752954.541828:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752954.541832:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182676480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752954.541855:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788752954.541863:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182676864:0@lo:400:kworker.0 00000100:00100000:1.0:1788752954.541893:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182676480:12345-0@lo:400:kworker.0 Request processed in 66us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752954.541902:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788752954.541914:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182676992 00000100:00100000:1.0:1788752954.541918:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182676992 00000100:00100000:0.0:1788752954.541923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752954.541979:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788752954.541980:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182676480:0@lo:400:kworker.0 00000100:00100000:3.0:1788752954.541990:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182676736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752954.542026:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000100:00100000:3.0:1788752954.542037:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182676736:12345-0@lo:400:kworker.0 Request processed in 49us (265us total) trans 0 rc 0/0 00000004:00080000:0.0:1788752954.542042:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000100:00100000:3.0:1788752954.542047:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788752954.542157:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182676352:0@lo:400:kworker.0 00000100:00100000:2.0:1788752954.542188:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182676864 00000100:00100000:2.0:1788752954.542191:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182676864 00000100:00100000:2.0:1788752954.542222:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788752954.542229:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182676864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752954.542270:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182676864:12345-0@lo:400:kworker.0 Request processed in 41us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752954.542275:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788752954.542309:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182676864:0@lo:400:kworker.0 00000100:00100000:2.0:1788752954.542430:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182676736:0@lo:400:kworker.0 00000100:00080000:3.0:1788752954.542529:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752954.542797:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788752954.542807:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182676992:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1788752954.542827:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9bbdf56680, transno 4294967301 00000100:00100000:0.0:1788752954.542854:0:3303:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9ba1562680 x1875643182675968/t4294967303(4294967303) o1000->lustre-OST0001-osc-MDT0000@0@lo:24/4 lens 408/4320 e 0 to 0 dl 1788752970 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'mdt_rdpg00_001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788752954.542874:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182676992:12345-0@lo:400:kworker.0 Request processed in 68us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752954.542878:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182676608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752954.542886:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788752954.542918:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182676992:0@lo:400:kworker.0 00000100:00100000:2.0:1788752954.550605:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.550893:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164838912 00000100:00100000:0.0:1788752954.550906:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164838912 00000100:00100000:0.0:1788752954.551036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:0.0:1788752954.551049:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+53:10547:x1875643164838912:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752954.551100:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752954.551161:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0be expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.551258:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849057e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.551275:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849057e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.551290:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849057e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752954.551334:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788752954.551339:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752954.551360:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849057e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.551391:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0be expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.551438:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849057e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0be expref: 54 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.551448:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752954.551451:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788752954.551455:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752954.551537:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+54:10547:x1875643164838912:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 491us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752954.551545:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:0.0:1788752954.557450:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.557527:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164839040 00000100:00100000:3.0:1788752954.557542:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164839040 00000100:00100000:3.0:1788752954.557701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00100000:3.0:1788752954.557714:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+54:10547:x1875643164839040:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752954.557742:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752954.557775:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0c5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.557867:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.557887:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.557903:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.557946:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.557954:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.557960:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558087:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558095:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752954.558175:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788752954.558181:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788752954.558204:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558217:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558226:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558233:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558271:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558277:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2ce00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752954.558282:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558291:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558306:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752954.558310:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752954.558315:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558322:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849058c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558337:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558343:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558348:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558354:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752954.558357:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558373:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558381:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9ba049d000) 00010000:00010000:3.0:1788752954.558383:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752954.558386:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558392:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558440:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558457:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.558464:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752954.558466:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752954.558469:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2cc00, rc 0) 00000100:00100000:3.0:1788752954.558556:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+55:10547:x1875643164839040:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 844us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.558565:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00100000:1.0:1788752954.562781:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752954.562839:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752954.563636:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164839296 00000100:00100000:2.0:1788752954.563724:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164839296 00000100:00100000:2.0:1788752954.563846:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00100000:2.0:1788752954.563865:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+55:10547:x1875643164839296:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752954.563895:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752954.563923:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484905a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0cc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.564060:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.564117:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.564152:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.564161:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.564206:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.564222:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 56 pid: 5832 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752954.564253:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182677120:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752954.564380:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.564391:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 56 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752954.564400:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1576300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182677248:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752954.564428:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a85766540 going to sleep for 11 seconds 00000100:00100000:3.0:1788752954.564545:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164839424 00000100:00100000:3.0:1788752954.564552:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164839424 00010000:00010000:3.0:1788752954.564580:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 57 pid: 5832 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.564618:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:3.0:1788752954.564627:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+57:2361:x1875643164839424:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752954.564639:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752954.564646:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 57 pid: 5832 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.564673:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 57 pid: 5832 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.564701:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752954.564706:0:11152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.564714:0:11152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.564721:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752954.564753:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+57:2361:x1875643164839424:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 127us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.564761:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:2.0:1788752954.572747:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:0.0:1788752954.572890:0:5834:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.5@tcp) returned -22 from blocking AST (req@00000000bb7e88b5 x1875643182677120) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 56 pid: 5832 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.572916:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849059a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0c5 expref: 56 pid: 5832 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752954.572937:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1577b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182677120:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752954.572962:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1576300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182677248:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752954.572992:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752954.572998:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.573008:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.573041:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752954.573476:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164839552 00000100:00100000:3.0:1788752954.573486:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164839552 00010000:00010000:3.0:1788752954.573530:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 56 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752954.573851:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:1.0:1788752954.573865:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+56:2361:x1875643164839552:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752954.573884:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752954.573892:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 56 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.573913:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 56 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.573943:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0b7 expref: 56 pid: 5835 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.574001:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:1.0:1788752954.574007:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.574015:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.574024:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752954.574055:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752954.574150:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+55:2361:x1875643164839552:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 289us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752954.574158:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00010000:00010000:0.0:1788752954.574428:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.574437:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752954.574463:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788752954.574672:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484905a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.574690:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752954.574699:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752954.574701:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788752954.574704:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928000, rc 0) 00000100:00100000:0.0:1788752954.574740:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+55:10547:x1875643164839296:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 10879us (11972us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788752954.574748:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 109 00000100:00100000:1.0:1788752954.579203:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.579344:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164839808 00000100:00100000:3.0:1788752954.579357:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164839808 00000100:00100000:3.0:1788752954.579448:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1788752954.579459:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+55:10547:x1875643164839808:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:3.0:1788752954.579477:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752954.579508:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0a2 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752954.579532:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752954.579538:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752954.579611:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+54:10547:x1875643164839808:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 154us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752954.579619:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1788752954.583279:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752954.583441:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164839936 00000100:00100000:3.0:1788752954.583454:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164839936 00000100:00100000:2.0:1788752954.583777:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:2.0:1788752954.583790:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+54:10547:x1875643164839936:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:2.0:1788752954.583926:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.583947:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.583961:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788752954.584271:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788752954.584382:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+54:10547:x1875643164839936:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 595us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752954.584390:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 110 00000100:00100000:0.0:1788752954.588519:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752954.589542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164840064 00000100:00100000:2.0:1788752954.589557:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164840064 00000100:00100000:2.0:1788752954.589643:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:2.0:1788752954.589667:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+54:10547:x1875643164840064:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752954.589698:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752954.589731:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0d3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.589809:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.589823:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.589870:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.589889:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.589907:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:2.0:1788752954.589910:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788752954.589915:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752954.589923:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928a00, rc 0) 00000100:00100000:2.0:1788752954.590006:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+55:10547:x1875643164840064:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 351us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752954.590013:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 111 00000100:00100000:0.0:1788752954.679336:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.679379:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.679536:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752954.679570:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752954.679630:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164840320 00000100:00100000:1.0:1788752954.679639:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164840320 00000100:00100000:1.0:1788752954.679698:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164840448 00000100:00100000:3.0:1788752954.679700:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164840192 00000100:00100000:1.0:1788752954.679701:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164840448 00000100:00100000:3.0:1788752954.679704:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164840192 00000100:00100000:3.0:1788752954.679730:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 281 00000100:00100000:1.0:1788752954.679730:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:3.0:1788752954.679740:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164840192:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752954.679740:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2358:x1875643164840320:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752954.679805:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2358:x1875643164840192:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 67us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752954.679811:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:3.0:1788752954.679812:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 281 00000100:00100000:0.0:1788752954.679840:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164840448:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752954.679966:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164840576 00000100:00100000:2.0:1788752954.679970:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164840576 00000100:00100000:2.0:1788752954.680020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:2.0:1788752954.680028:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164840576:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752954.680247:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2358:x1875643164840320:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 508us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752954.680261:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:0.0:1788752954.680412:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+5:2358:x1875643164840448:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 573us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752954.680419:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00080000:3.0:1788752954.680989:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752954.681641:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2358:x1875643164840576:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1609us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752954.681651:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00000040:00080000:1.0:1788752955.050516:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788752955.050528:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788752955.050583:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788752955.050590:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788752955.050714:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182677376:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788752955.050836:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788752955.058231:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091ed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182677376:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788752955.060058:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.064162:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164840704 00000100:00100000:0.0:1788752955.064181:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164840704 00000100:00100000:0.0:1788752955.064280:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00100000:0.0:1788752955.064300:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+55:10548:x1875643164840704:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788752955.064334:0:5834:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788752955.064465:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+55:10548:x1875643164840704:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 167us (4418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.064473:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 112 00000100:00080000:3.0:1788752955.064606:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752955.070953:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.071425:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164840832 00000100:00100000:0.0:1788752955.071436:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164840832 00000100:00100000:0.0:1788752955.071495:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:0.0:1788752955.071505:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+55:10548:x1875643164840832:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788752955.071700:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071723:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071748:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071806:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071836:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071845:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071871:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071881:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071888:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752955.071928:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788752955.071933:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752955.071947:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071957:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071964:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071972:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071978:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752955.071981:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.071995:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072008:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:0.0:1788752955.072011:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752955.072017:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072023:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484905c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072037:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072042:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072049:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072054:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752955.072057:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072063:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072070:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9c9b9424ba00) 00010000:00010000:0.0:1788752955.072072:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752955.072075:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072091:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905cb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072107:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072114:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072175:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072182:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752955.072185:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072191:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072200:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752955.072202:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752955.072206:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.072212:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752955.074120:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+55:10548:x1875643164840832:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 784us (1348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.074186:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 113 00000100:00100000:1.0:1788752955.085878:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.085992:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164841088 00000100:00100000:0.0:1788752955.086004:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164841088 00000100:00100000:0.0:1788752955.086063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:0.0:1788752955.086073:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+55:10548:x1875643164841088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752955.086095:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752955.086119:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0da expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086257:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086272:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086394:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752955.086411:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788752955.086525:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086533:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086540:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086546:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752955.086550:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086558:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086584:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752955.086587:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788752955.086593:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086599:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484905e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086648:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0da expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086670:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:0.0:1788752955.086673:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788752955.086677:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f484905d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0da expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.086687:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8000, rc 0) 00000100:00100000:0.0:1788752955.086759:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+56:10548:x1875643164841088:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 687us (895us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788752955.086767:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 114 00000100:00100000:1.0:1788752955.092676:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.092755:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164841216 00000100:00100000:2.0:1788752955.092765:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164841216 00000100:00100000:2.0:1788752955.092824:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:2.0:1788752955.092833:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+56:10548:x1875643164841216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788752955.092887:0:5832:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788752955.092993:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+56:10548:x1875643164841216:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 160us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752955.093000:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 115 00000100:00100000:3.0:1788752955.096298:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.096857:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164841472 00000100:00100000:2.0:1788752955.096868:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164841472 00000100:00100000:2.0:1788752955.096984:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:2.0:1788752955.096995:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+56:10548:x1875643164841472:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752955.097018:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752955.097022:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788752955.097051:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f4849057e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0be expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.097070:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:2.0:1788752955.097076:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752955.097092:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f484905ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0e1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788752955.097638:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788752955.097929:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484905f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.097944:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484905f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.097956:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484905f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.098035:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929c00/0x80c8383f484905ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e1 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.098054:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484905f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e1 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.098063:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9b89426b00) 00010000:00010000:2.0:1788752955.098065:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752955.098068:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b85928800, rc 0) 00000100:00100000:2.0:1788752955.098172:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+57:10548:x1875643164841472:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1177us (1893us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788752955.098180:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 116 00000100:00100000:1.0:1788752955.101773:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.102373:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164841728 00000100:00100000:0.0:1788752955.102384:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164841728 00000100:00100000:2.0:1788752955.102482:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:2.0:1788752955.102496:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+57:10548:x1875643164841728:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788752955.102566:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752955.102610:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928800/0x80c8383f484905f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e1 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102633:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9b89426b00) 00010000:00010000:2.0:1788752955.102646:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752955.102680:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102694:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102703:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102754:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102763:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102770:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102850:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102858:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102865:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102871:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85929a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752955.102875:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102883:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102892:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:2.0:1788752955.102895:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752955.102899:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102905:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929a00/0x80c8383f48490603 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102924:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102930:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102936:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102942:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752955.102945:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102951:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102958:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd32cac82 (ffff9c9b89426700) 00010000:00010000:2.0:1788752955.102960:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752955.102963:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.102969:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849060a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd32cac82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.103062:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+56:10548:x1875643164841728:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 569us (1301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788752955.103069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 117 00000100:00100000:3.0:1788752955.105711:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.105927:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164841856 00000100:00100000:1.0:1788752955.105939:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164841856 00000100:00100000:1.0:1788752955.106007:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:1.0:1788752955.106018:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+56:10548:x1875643164841856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752955.106044:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752955.106065:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490611 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0e8 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.106107:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.106148:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.106162:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.106310:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 58 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.106330:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 57 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.106340:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:1.0:1788752955.106343:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788752955.106347:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271200, rc 0) 00000100:00100000:1.0:1788752955.106427:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+57:10548:x1875643164841856:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 409us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752955.106435:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 118 00000100:00100000:3.0:1788752955.108845:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752955.108887:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164842112 00000100:00100000:3.0:1788752955.108913:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164842112 00000100:00100000:3.0:1788752955.108960:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:3.0:1788752955.108971:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+57:10548:x1875643164842112:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752955.109077:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.109096:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.109109:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788752955.109428:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1788752955.109437:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354843313548ns, next at 355843311445ns, rc = 0 00000004:00010000:3.0:1788752955.109530:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009ce9c2e2 reply state 00000000b4306869 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752955.109542:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788752955.109669:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+59:10548:x1875643164842112:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 686us (821us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788752955.109677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:1.0:1788752955.113028:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.113552:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164842240 00000100:00100000:2.0:1788752955.113566:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164842240 00000100:00100000:2.0:1788752955.113630:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:2.0:1788752955.113665:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+59:10548:x1875643164842240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752955.113692:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752955.113717:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0ef expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.113783:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 60 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.113799:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 60 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.113820:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:2.0:1788752955.113824:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788752955.113828:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1a00, rc 0) 00000100:00100000:2.0:1788752955.113889:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+60:10548:x1875643164842240:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 237us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752955.113896:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 120 00000100:00100000:3.0:1788752955.117214:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.117336:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164842368 00000100:00100000:1.0:1788752955.117348:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164842368 00000100:00100000:1.0:1788752955.117422:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:1.0:1788752955.117433:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164842368:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788752955.117793:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164842368:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 359us (589us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788752955.117802:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00080000:3.0:1788752955.118276:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788752955.120593:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.120615:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.120625:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.120665:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752955.120671:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.120680:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.120701:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:0.0:1788752955.120705:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788752955.120711:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.120717:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849061f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752955.123544:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.125716:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164842624 00000100:00100000:2.0:1788752955.125848:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164842624 00000100:00100000:2.0:1788752955.125966:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:2.0:1788752955.125977:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+59:10548:x1875643164842624:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788752955.126945:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+60:10548:x1875643164842624:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 965us (3408us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788752955.126956:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:1.0:1788752955.133064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.133482:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164842880 00000100:00100000:2.0:1788752955.133492:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164842880 00000100:00100000:2.0:1788752955.133576:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:2.0:1788752955.133587:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+60:10548:x1875643164842880:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788752955.133709:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+60:10548:x1875643164842880:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 123us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752955.133717:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 121 00000100:00100000:1.0:1788752955.137221:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.137433:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164843008 00000100:00100000:2.0:1788752955.137444:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164843008 00000100:00100000:2.0:1788752955.137541:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:2.0:1788752955.137551:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+60:10548:x1875643164843008:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752955.137573:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752955.137595:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849062d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0f6 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.137679:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.137695:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.137706:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752955.137752:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752955.137771:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.137798:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f4849062d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0f6 expref: 62 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.137829:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0f6 expref: 61 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.137837:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:2.0:1788752955.137839:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788752955.137843:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0000, rc 0) 00000100:00100000:2.0:1788752955.137915:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+61:10548:x1875643164843008:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 366us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752955.137922:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 122 00000100:00100000:3.0:1788752955.144305:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.144448:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164843136 00000100:00100000:0.0:1788752955.144461:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164843136 00000100:00100000:0.0:1788752955.144528:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:0.0:1788752955.144541:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+9:2360:x1875643164843136:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752955.144563:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752955.144592:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f0fd expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788752955.144626:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e343b, blocks: 0x1 00010000:00010000:0.0:1788752955.144647:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1788752955.144661:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752955.144672:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.144715:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 10 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.144729:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8000, rc 0) 00000100:00100000:0.0:1788752955.144792:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+10:2360:x1875643164843136:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 253us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.144799:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:3.0:1788752955.149211:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.149426:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164843392 00000100:00100000:0.0:1788752955.149436:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164843392 00000100:00100000:0.0:1788752955.149501:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:0.0:1788752955.149511:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+61:10548:x1875643164843392:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788752955.149626:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+61:10548:x1875643164843392:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 115us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.149635:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 123 00000100:00100000:2.0:1788752955.155167:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.155261:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164843520 00000100:00100000:1.0:1788752955.155273:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164843520 00000100:00100000:1.0:1788752955.155340:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1788752955.155352:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+10:10548:x1875643164843520:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752955.155387:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752955.155409:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f104 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.155442:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.155451:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752955.155456:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752955.155461:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.155496:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.155509:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 11 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752955.155525:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1875643182677504:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752955.155631:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752955.165198:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.165460:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164843648 00000100:00100000:2.0:1788752955.165471:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164843648 00010000:00010000:2.0:1788752955.165527:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 12 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.165583:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:2.0:1788752955.165595:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+12:2360:x1875643164843648:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752955.165612:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752955.165637:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 12 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.165662:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 12 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.165688:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752955.165705:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752955.165714:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.165725:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.165774:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.165788:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1576a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875643182677632:192.168.203.5@tcp:105: 00000100:00100000:2.0:1788752955.165859:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a85766780 going to sleep for 11 seconds 00010000:00010000:1.0:1788752955.168015:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d786efec/0x80c8383f4849063b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0fd expref: 12 pid: 6688 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752955.168045:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1875643182677504:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752955.168081:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.168119:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271e00, rc 0) 00000100:00100000:1.0:1788752955.168254:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb531d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+11:10548:x1875643164843520:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 12904us (13099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752955.168262:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:2.0:1788752955.173582:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1576a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875643182677632:192.168.203.5@tcp:105: 00010000:00010000:2.0:1788752955.173610:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752955.173683:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+10:2360:x1875643164843648:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 8088us (8495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752955.173694:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:0.0:1788752955.177866:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.178177:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164843776 00000100:00100000:2.0:1788752955.178187:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164843776 00002000:00100000:2.0:1788752955.178255:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c9ba1569500 x1875643164843776/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:171/0 lens 504/0 e 0 to 0 dl 1788752966 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788752955.178267:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9ba1569500 with x1875643164843776 ext(0->12) 00002000:00010000:2.0:1788752955.178273:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9ba1569500 00000100:00100000:2.0:1788752955.178364:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1788752955.178376:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+10:2361:x1875643164843776:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788752955.179250:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+12:2361:x1875643164843776:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 861us (1381us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788752955.179260:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00002000:00100000:2.0:1788752955.179272:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c9ba1569500 x1875643164843776/t4294967308(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:171/0 lens 504/448 e 0 to 0 dl 1788752966 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788752955.179282:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9ba1569500 with x1875643164843776 ext(0->12) 00002000:00010000:2.0:1788752955.179299:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9ba1569500 00000100:00100000:0.0:1788752955.191106:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.191839:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164843904 00000100:00100000:1.0:1788752955.191851:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164843904 00000100:00100000:1.0:1788752955.191921:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 124 00000100:00100000:1.0:1788752955.191932:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+61:10548:x1875643164843904:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788752955.258045:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:2.0:1788752955.258226:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788752955.258558:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788752955.258581:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182677760:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788752955.258667:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1788752955.258752:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788752955.258767:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788752955.258783:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9a85766240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788752955.258787:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5aec400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9a85766d80 00000020:00080000:2.0:1788752955.258790:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5aeca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9bbdde9400 00000020:00080000:2.0:1788752955.258803:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9a85766600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788752955.258806:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5aec600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9a857660c0 00000020:00080000:2.0:1788752955.258808:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5aec100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9bbe266c00 00000020:00080000:2.0:1788752955.258814:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788752955.258852:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788752955.259066:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788752955.259080:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182677888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788752955.259156:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752955.259200:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182677760 00000100:00100000:2.0:1788752955.259208:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182677760 00000100:00100000:2.0:1788752955.259264:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182677888 00000100:00100000:2.0:1788752955.259267:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182677888 00000100:00100000:0.0:1788752955.259423:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788752955.259437:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182677760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788752955.259468:0:6688:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788752955.259494:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.259518:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.259540:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788752955.259545:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788752955.259549:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.259580:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.259594:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 11 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752955.259606:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1568a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875643182678016:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752955.259679:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b85654840 going to sleep for 11 seconds 00000100:00100000:2.0:1788752955.260661:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788752955.260675:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182677888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788752955.260696:0:9256:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1788752955.260729:0:9256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9e343a, atime: 0x0, ctime: 0x6a9e343a, blocks: 0xb 00010000:00010000:2.0:1788752955.260737:0:9256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.260751:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1788752955.260755:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752955.260761:0:9256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.260777:0:9256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.260788:0:9256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.260797:0:9256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.260813:0:9256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1788752955.261220:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752955.261575:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+27:10548:x1875643164843904:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 69639us (70473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752955.261595:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 124 00010000:00010000:0.0:1788752955.263958:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752955.263975:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.263990:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752955.263995:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.264007:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.264052:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.264061:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9a8a9a5/0x80c8383f48490650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.264089:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752955.264091:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752955.264093:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788752955.264474:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788752955.264645:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182678144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788752955.265618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752955.265762:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788752955.265773:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788752955.266495:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182678144 00000100:00100000:3.0:1788752955.266506:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182678144 00000100:00100000:2.0:1788752955.267033:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875643182677888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6358us (7872us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788752955.267043:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788752955.267072:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788752955.267083:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1875643182678144:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788752955.267588:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9ba1576680/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788752955.267596:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182677888:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1788752955.267940:0:9256:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788752955.267944:0:9256:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788752955 00002000:00010000:2.0:1788752955.267947:0:9256:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788752955.267949:0:9256:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788752955 -> 1788752955 00002000:00010000:2.0:1788752955.267951:0:9256:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788752955.268012:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3305:x1875643182678144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 931us (3282us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788752955.268020:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:0.0:1788752955.268442:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9ba1568700/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788752955.268450:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182678144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788752955.268789:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.268822:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.268852:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164844160 00000100:00100000:0.0:1788752955.268859:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164844160 00010000:00010000:0.0:1788752955.268892:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 12 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752955.268926:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:0.0:1788752955.268934:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+12:2361:x1875643164844160:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752955.268949:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752955.268955:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 12 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.268982:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 12 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.269012:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:0.0:1788752955.269017:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788752955.269023:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.269034:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.269055:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752955.269100:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+12:2361:x1875643164844160:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 167us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.269109:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:3.0:1788752955.269340:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164844032 00000100:00100000:3.0:1788752955.269346:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164844032 00000100:00100000:3.0:1788752955.269385:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:3.0:1788752955.269391:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+12:2360:x1875643164844032:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788752955.269623:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d3b44e/0x80c8383f4849040b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f063 expref: 12 pid: 6691 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.269641:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1568a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875643182678016:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752955.269674:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.269684:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.269691:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.269716:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.269724:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.269758:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788752955.270353:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3304:x1875643182677760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10919us (11684us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788752955.270361:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1788752955.270676:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788752955.270684:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.270694:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788752955.270699:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.270708:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.270727:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.270745:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c860fbe/0x80c8383f48490649 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.270777:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752955.270779:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752955.270781:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788752955.270816:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9ba1576a00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788752955.270822:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182677760:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788752955.306490:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788752955.311104:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788752955.311148:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1788752955.311156:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788752955.311163:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:0.0:1788752955.311665:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164844032:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 42256us (42861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.311677:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:0.0:1788752955.325067:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752955.325183:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164844416 00000100:00100000:3.0:1788752955.325197:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164844416 00000100:00100000:3.0:1788752955.325339:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 125 00000100:00100000:3.0:1788752955.325351:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+15:10548:x1875643164844416:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752955.326461:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752955.326497:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0f6 expref: 15 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.326519:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:3.0:1788752955.326524:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752955.326559:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.326576:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.326586:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788752955.326897:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000006c9f655b reply state 00000000560a4773 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752955.326929:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788752955.327040:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+16:10548:x1875643164844416:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1690us (1985us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1788752955.327049:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 125 00010000:00010000:1.0:1788752955.330763:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.330783:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.330792:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.330799:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752955.330804:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.330812:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.330829:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:1.0:1788752955.330832:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752955.330851:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.330858:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490657 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752955.333323:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.333436:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164844544 00000100:00100000:1.0:1788752955.333448:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164844544 00000100:00100000:1.0:1788752955.333513:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:1.0:1788752955.333524:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164844544:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788752955.333844:0:12054:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788752955.333849:0:12054:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788752955 -> 1788752954 00002000:00010000:1.0:1788752955.333851:0:12054:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788752954 00002000:00010000:1.0:1788752955.333854:0:12054:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788752955 -> 1788752954 00002000:00010000:1.0:1788752955.333856:0:12054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788752955.333917:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164844544:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 393us (605us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788752955.333925:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1788752955.338638:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.338871:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164844800 00000100:00100000:2.0:1788752955.338884:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164844800 00000100:00100000:2.0:1788752955.338947:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:2.0:1788752955.338959:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+15:10548:x1875643164844800:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788752955.339033:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.339051:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 15 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.339062:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.339164:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 15 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.339180:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 15 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.339195:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1577100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182678272:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752955.339285:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba1826cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752955.347368:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752955.347723:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164844928 00000100:00100000:3.0:1788752955.347745:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164844928 00010000:00010000:3.0:1788752955.347791:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 16 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752955.347840:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:3.0:1788752955.347851:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+16:2360:x1875643164844928:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752955.347869:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752955.347877:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 16 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.347893:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 16 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.347916:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:3.0:1788752955.347922:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.347933:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.347940:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.347978:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752955.348046:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+16:2360:x1875643164844928:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 196us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752955.348054:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00010000:00010000:2.0:1788752955.350852:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0e8 expref: 15 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.350883:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1577100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182678272:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752955.351258:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351270:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351276:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351311:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351318:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351326:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351350:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752955.351355:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351364:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351530:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:2.0:1788752955.351534:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788752955.351540:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.351547:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849065e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.352532:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+14:10548:x1875643164844800:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 13566us (13896us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788752955.352545:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 126 00000100:00100000:0.0:1788752955.378788:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.378996:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164845056 00000100:00100000:1.0:1788752955.379006:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164845056 00000100:00100000:1.0:1788752955.379105:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:1.0:1788752955.379115:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164845056:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788752955.379191:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.379212:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.379240:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788752955.379244:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788752955.379249:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.380870:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.380895:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 7 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752955.380922:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1875643182678400:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752955.381040:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bb5bbdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752955.387762:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.387873:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1875643182678400:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752955.387961:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.388041:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164845184 00000100:00100000:2.0:1788752955.388048:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164845184 00010000:00010000:2.0:1788752955.388082:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 8 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752955.388117:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:2.0:1788752955.388157:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2360:x1875643164845184:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752955.388170:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752955.388195:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 8 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.388229:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 8 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.388251:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b7d4dc/0x80c8383f48490642 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f104 expref: 8 pid: 6690 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.388267:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752955.388272:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752955.388277:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.388296:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.388317:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752955.388367:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164845184:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 212us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752955.388374:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00010000:00010000:1.0:1788752955.388611:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388620:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388642:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388665:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388673:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388680:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752955.388683:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388691:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388702:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.388709:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009960451b/0x80c8383f48490665 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752955.388770:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164845056:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 9658us (9995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752955.388777:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:0.0:1788752955.394612:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.396504:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164845440 00000100:00100000:2.0:1788752955.396520:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164845440 00000100:00100000:3.0:1788752955.396751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:3.0:1788752955.396762:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+14:10548:x1875643164845440:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788752955.396855:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.396873:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.396887:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.397370:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.397561:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 15 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.397571:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.397609:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 15 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.397635:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 15 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752955.397678:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf54000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182678528:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752955.397770:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d61cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788752955.402702:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752955.402834:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164845568 00000100:00100000:1.0:1788752955.402846:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164845568 00010000:00010000:1.0:1788752955.402897:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 16 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752955.402972:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:1.0:1788752955.402985:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+16:2361:x1875643164845568:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752955.403000:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752955.403007:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 16 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.403020:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 16 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.403042:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:1.0:1788752955.403048:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.403058:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.403066:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.403088:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752955.403185:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+16:2361:x1875643164845568:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 202us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752955.403194:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00010000:00010000:0.0:1788752955.403481:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490626 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0ef expref: 15 pid: 7899 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752955.403506:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf54000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182678528:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752955.403528:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.403538:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.403544:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752955.403753:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788752955.404221:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788752955.404276:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788752955.404364:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875643182678656:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788752955.404432:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752955.404469:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baff61480 going to sleep for 11 seconds 00000100:00100000:2.0:1788752955.404539:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182678656 00000100:00100000:2.0:1788752955.404547:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182678656 00000100:00100000:2.0:1788752955.404597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788752955.404607:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875643182678656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788752955.404710:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875643182678656:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752955.404731:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788752955.404765:0:5835:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788752955.404771:0:5835:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1788752955.404798:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9ba1568700, transno 4294967309 00000004:00080000:3.0:1788752955.404940:0:5835:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9ba1576a00, transno 4294967310 00000100:00100000:3.0:1788752955.406613:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1568e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875643182678656:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788752955.407636:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788752955.407732:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf56300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875643182678784:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788752955.407967:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752955.408072:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752955.408207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182678784 00000100:00100000:2.0:1788752955.408215:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182678784 00000100:00100000:0.0:1788752955.408470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788752955.408483:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875643182678784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788752955.408712:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1875643182678784:12345-0@lo:1000:mdt00_002.0 Request processed in 231us (744us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788752955.408719:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788752955.409020:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf56300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5835:1875643182678784:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788752955.409056:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409066:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409074:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409080:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2ce00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752955.409084:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409091:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409114:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9ba3667c00) 00010000:00010000:3.0:1788752955.409117:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752955.409244:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409252:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490673 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409280:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409287:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409292:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409297:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752955.409299:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409304:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409312:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752955.409314:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752955.409321:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409332:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.409348:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.410253:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752955.410273:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182678912:192.168.203.5@tcp:105: 00000100:00100000:3.0:1788752955.410414:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752955.414811:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.414997:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164845696 00000100:00100000:0.0:1788752955.415007:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164845696 00000100:00100000:0.0:1788752955.415157:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1788752955.415169:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+19:10547:x1875643164845696:12345-192.168.203.5@tcp:49:lfs.0 00000100:00100000:0.0:1788752955.415314:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+19:10547:x1875643164845696:12345-192.168.203.5@tcp:49:lfs.0 Request processed in 147us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.415335:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:3.0:1788752955.419570:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf55880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182678912:192.168.203.5@tcp:105: 00010000:00010000:3.0:1788752955.419614:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419625:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928e00/0x80c8383f484905b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419667:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419680:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419690:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419700:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419706:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419720:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419725:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2ce00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752955.419729:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419736:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419747:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752955.419750:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752955.419754:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419760:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f4849067a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419769:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419774:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419780:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419783:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752955.419797:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419812:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419819:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752955.419821:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788752955.419824:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752955.419829:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849066c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788752955.420280:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752955.420295:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788752955.421158:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+18:10548:x1875643164845440:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 24392us (26554us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788752955.421173:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000020:00080000:3.0:1788752955.421181:0:5835:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788752955.421226:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752955.421364:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164845952 00000100:00100000:3.0:1788752955.421427:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164845952 00000100:00100000:3.0:1788752955.421471:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 128 00000040:00080000:0.0:1788752955.422101:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788752955.422112:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788752955.422244:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+18:10547:x1875643164845952:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:3.0:1788752955.423846:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788752955.424180:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+18:10547:x1875643164845952:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 2695us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752955.424190:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:1.0:1788752955.427196:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752955.427325:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164846208 00000100:00100000:2.0:1788752955.427338:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164846208 00000100:00100000:2.0:1788752955.427416:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:2.0:1788752955.427428:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f77b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+18:10548:x1875643164846208:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788752955.428425:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788752955.428525:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788752955.428991:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.429009:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.429024:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.429033:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.429040:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.429046:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752955.429068:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788752955.429186:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f77b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+20:10548:x1875643164846208:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1759us (1998us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788752955.429206:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000020:00080000:2.0:1788752955.429211:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788752955.429489:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752955.429497:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.429505:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752955.429509:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.429516:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.429531:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c9b89426c00) 00010000:00010000:0.0:1788752955.429534:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788752955.429538:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.429544:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.429562:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752955.429564:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752955.429566:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752955.463114:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.463310:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164846336 00000100:00100000:0.0:1788752955.463319:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164846336 00000100:00100000:0.0:1788752955.463422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 129 00000100:00100000:0.0:1788752955.463431:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+20:10550:x1875643164846336:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752955.463466:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752955.463489:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490688 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f10b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463556:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463589:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463602:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463618:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463626:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463632:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463874:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463885:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463894:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463941:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.463963:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 21 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752955.463977:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba156b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182679040:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752955.465054:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baff61240 going to sleep for 11 seconds 00000100:00100000:1.0:1788752955.469937:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752955.470217:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164846592 00000100:00100000:3.0:1788752955.470226:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164846592 00000100:00100000:3.0:1788752955.470298:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:3.0:1788752955.470310:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+22:5596:x1875643164846592:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788752955.470752:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+23:5596:x1875643164846592:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 444us (826us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788752955.470760:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:0.0:1788752955.473828:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba156b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182679040:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752955.473865:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752955.474055:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752955.474372:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164846720 00000100:00100000:0.0:1788752955.474380:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164846720 00010000:00010000:1.0:1788752955.474565:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 23 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752955.474736:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:1.0:1788752955.474748:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+23:2360:x1875643164846720:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752955.474765:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752955.474772:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 23 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.474785:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 23 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.474808:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928000/0x80c8383f484905a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0cc expref: 23 pid: 5834 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.474826:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:1.0:1788752955.474831:0:11152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.474842:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.474850:0:11152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752955.474880:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752955.474945:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+22:2360:x1875643164846720:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 199us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752955.474967:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00010000:00010000:0.0:1788752955.475413:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475421:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752955.475468:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788752955.475473:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752955.475492:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475506:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475516:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475523:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475538:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475545:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752955.475549:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475558:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475579:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:0.0:1788752955.475582:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752955.475586:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475592:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f4849068f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475604:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475610:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475616:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475621:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752955.475624:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475644:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475663:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c9b9424b300) 00010000:00010000:0.0:1788752955.475666:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752955.475670:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475676:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475718:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490688 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f10b expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475732:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f10b expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752955.475740:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752955.475742:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752955.475744:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8000, rc 0) 00000100:00100000:0.0:1788752955.475800:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+21:10550:x1875643164846336:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 12369us (12694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752955.475808:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 129 00000040:00080000:2.0:1788752956.229550:0:12092:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788752956.229559:0:12092:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788752956.229605:0:12092:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788752956.229611:0:12092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788752956.332860:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788752956.458895:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752956.458905:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752956.458957:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788752956.458963:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788752956.459172:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba156b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182679168:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788752956.459282:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baff61240 going to sleep for 11 seconds 00000100:00100000:0.0:1788752956.464488:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba156b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182679168:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788752956.467542:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752956.468008:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164846848 00000100:00100000:3.0:1788752956.468020:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164846848 00000100:00100000:3.0:1788752956.468166:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:3.0:1788752956.468179:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+21:10562:x1875643164846848:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788752956.468226:0:5834:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788752956.468362:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+21:10562:x1875643164846848:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 184us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752956.468370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 130 00000100:00100000:2.0:1788752956.474699:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752956.478109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164847104 00000100:00100000:3.0:1788752956.478141:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164847104 00000100:00100000:3.0:1788752956.478381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:3.0:1788752956.478393:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+21:10562:x1875643164847104:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788752956.478416:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752956.478488:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f112 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.478601:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484906ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.478616:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484906ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.478628:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484906ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752956.478669:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788752956.478809:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f112 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.478828:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484906ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f112 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.478836:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752956.478839:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752956.478842:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ce00, rc 0) 00000100:00100000:3.0:1788752956.478988:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+23:10562:x1875643164847104:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 597us (4302us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788752956.478996:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 131 00000100:00100000:1.0:1788752956.483543:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752956.483634:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164847232 00000100:00100000:3.0:1788752956.483656:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164847232 00000100:00100000:3.0:1788752956.484007:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788752956.484020:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+23:2359:x1875643164847232:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752956.484041:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752956.484071:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484906ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f112 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.484102:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752956.484107:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752956.484195:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+22:2359:x1875643164847232:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 177us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752956.484203:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1788752956.489630:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752956.490467:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164847488 00000100:00100000:3.0:1788752956.490481:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164847488 00000100:00100000:3.0:1788752956.490564:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:3.0:1788752956.490579:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+22:10562:x1875643164847488:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788752956.490697:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490718:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490731:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490936:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490946:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490953:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490959:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752956.490964:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490971:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.490983:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752956.490987:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788752956.491010:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752956.491017:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752956.491247:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+23:10562:x1875643164847488:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 670us (1625us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788752956.491256:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 132 00000040:00080000:1.0:1788752956.491606:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788752956.491612:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788752956.492154:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788752956.492163:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788752956.493699:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752956.493729:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164847744 00000100:00100000:2.0:1788752956.493738:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164847744 00000100:00100000:2.0:1788752956.493795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:2.0:1788752956.493805:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+23:10562:x1875643164847744:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788752956.494042:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+24:10562:x1875643164847744:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 238us (349us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788752956.494050:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00010000:00010000:1.0:1788752957.354364:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788752957.984829:0:12143:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752957.984839:0:12143:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752957.984885:0:12143:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788752957.984891:0:12143:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788752958.112275:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752958.112458:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848000 00000100:00100000:0.0:1788752958.112470:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848000 00000100:00100000:0.0:1788752958.112553:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:0.0:1788752958.112565:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+24:10583:x1875643164848000:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752958.112592:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788752958.112760:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788752958.112941:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484906c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f119 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752958.113380:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484906c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752958.113397:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484906c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752958.113410:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484906c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752958.113424:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788752958.114045:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484906c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f119 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752958.114062:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484906c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f119 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752958.114091:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:0.0:1788752958.114094:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788752958.114098:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8400, rc 0) 00000100:00100000:0.0:1788752958.114194:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+26:10583:x1875643164848000:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1630us (1930us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788752958.114202:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:1.0:1788752958.120571:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752958.121262:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848128 00000100:00100000:3.0:1788752958.121280:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848128 00000100:00100000:3.0:1788752958.121469:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:3.0:1788752958.121491:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+26:10583:x1875643164848128:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1788752958.121670:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121742:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121826:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121869:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121876:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121884:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121909:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752958.121915:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121923:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121939:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752958.121942:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788752958.121948:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752958.121955:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f484906d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752958.122059:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+26:10583:x1875643164848128:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 574us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752958.122069:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 134 00000100:00100000:1.0:1788752958.204596:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752958.204809:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848256 00000100:00100000:0.0:1788752958.204822:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848256 00000100:00100000:0.0:1788752958.204909:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00080000:3.0:1788752958.204923:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752958.204924:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2358:x1875643164848256:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1788752958.204951:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752958.204987:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cdeab26/0x80c8383f484906dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f120 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788752958.205015:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e343a, atime: 0x6a9e343a, ctime: 0x6a9e343a, blocks: 0xb 00010000:00010000:0.0:1788752958.205037:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1788752958.205042:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752958.205052:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cdeab26/0x80c8383f484906dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f120 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752958.205073:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007cdeab26/0x80c8383f484906dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f120 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752958.205088:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8a00, rc 0) 00000100:00100000:0.0:1788752958.205191:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:2358:x1875643164848256:12345-192.168.203.5@tcp:101:cat.0 Request processed in 271us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752958.205215:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1788752958.217949:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752958.218096:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848384 00000100:00100000:3.0:1788752958.218163:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848384 00002000:00100000:3.0:1788752958.218260:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9c9bbde20e00 x1875643164848384/t0(0) o3->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:174/0 lens 488/0 e 0 to 0 dl 1788752969 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788752958.218283:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbde20e00 with x1875643164848384 ext(0->4095) 00002000:00010000:3.0:1788752958.218293:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbde20e00 00000100:00100000:3.0:1788752958.218341:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:3.0:1788752958.218355:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164848384:12345-192.168.203.5@tcp:3:cat.0 00000100:00100000:3.0:1788752958.220648:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164848384:12345-192.168.203.5@tcp:3:cat.0 Request processed in 2273us (2687us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788752958.220682:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00002000:00100000:3.0:1788752958.220696:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9c9bbde20e00 x1875643164848384/t0(0) o3->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:174/0 lens 488/4536 e 0 to 0 dl 1788752969 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788752958.220706:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbde20e00 with x1875643164848384 ext(0->4095) 00002000:00010000:3.0:1788752958.220713:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbde20e00 00010000:00010000:0.0:1788752958.378459:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752958.637078:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788752958.637117:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182679296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752958.637232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752958.637512:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182679296 00000100:00100000:3.0:1788752958.637522:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182679296 00000100:00100000:3.0:1788752958.637608:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788752958.637618:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182679296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752958.637668:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788752958.637729:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182679296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752958.637736:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788752958.637799:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788752958.637877:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182679296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788752959.406111:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752959.658478:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788752959.658508:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182679808:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.658552:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182679424:0@lo:400:kworker.0 00000100:00100000:0.0:1788752959.658602:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752959.658611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752959.658669:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182679680:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.658722:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182679936:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.658751:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752959.658774:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788752959.658779:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182679552:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.658798:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752959.658812:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182680064:0@lo:400:kworker.0 00000100:00100000:0.0:1788752959.658833:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752959.658840:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752959.658885:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182679424 00000100:00100000:0.0:1788752959.658889:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182679936 00000100:00100000:3.0:1788752959.658908:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182679424 00000100:00100000:0.0:1788752959.658908:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182679936 00000100:00100000:0.0:1788752959.658969:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182679552 00000100:00100000:3.0:1788752959.658971:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788752959.658982:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182679424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.659034:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182679424:12345-0@lo:400:kworker.0 Request processed in 54us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752959.659041:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788752959.659074:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182679680 00000100:00100000:3.0:1788752959.659077:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182679680 00000100:00100000:3.0:1788752959.659095:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788752959.659101:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182679936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.659164:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182679936:12345-0@lo:400:kworker.0 Request processed in 63us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752959.659171:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788752959.659184:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788752959.659190:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182679680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.659219:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182679680:12345-0@lo:400:kworker.0 Request processed in 30us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752959.659225:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788752959.659327:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182679552 00000100:00100000:0.0:1788752959.659359:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788752959.659367:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182679552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752959.659408:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182679552:12345-0@lo:400:kworker.0 Request processed in 41us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752959.659415:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788752959.659423:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182679808 00000100:00100000:1.0:1788752959.659429:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182679808 00000100:00080000:0.0:1788752959.659438:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752959.659460:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680064 00000100:00100000:1.0:1788752959.659463:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680064 00000100:00100000:1.0:1788752959.659490:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788752959.659497:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182679808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752959.659532:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182679808:12345-0@lo:400:kworker.0 Request processed in 35us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752959.659537:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788752959.659548:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788752959.659553:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875643182680064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752959.659588:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3303:x1875643182680064:12345-0@lo:400:kworker.0 Request processed in 35us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752959.659594:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788752959.660348:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788752959.660498:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182679424:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.660525:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182679936:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.660557:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182679552:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.660719:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182680064:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.660812:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182679808:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.660857:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182679680:0@lo:400:kworker.0 00000100:00100000:3.0:1788752959.660882:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788752959.660893:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182680192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752959.660946:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752959.660994:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680192 00000100:00100000:2.0:1788752959.661002:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680192 00000100:00100000:2.0:1788752959.661047:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788752959.661055:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875643182680192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788752959.661086:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788752959.661174:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875643182680192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752959.661181:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788752959.661464:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1574700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182680192:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788752959.710118:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1788752959.710318:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:2.0:1788752959.804937:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752959.805018:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752959.805063:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752959.805093:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752959.805147:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752959.806398:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848768 00000100:00100000:1.0:1788752959.806419:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848768 00000100:00100000:1.0:1788752959.806517:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848896 00000100:00100000:1.0:1788752959.806521:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848896 00000100:00100000:3.0:1788752959.806662:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164849024 00000100:00100000:3.0:1788752959.806670:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164849024 00000100:00100000:3.0:1788752959.806715:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848640 00000100:00100000:3.0:1788752959.806719:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848640 00000100:00100000:1.0:1788752959.806732:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:3.0:1788752959.806749:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:3.0:1788752959.806761:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164849024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752959.806836:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:2359:x1875643164848768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752959.806909:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164849024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 150us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752959.806919:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 127 00000100:00100000:3.0:1788752959.806944:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00100000:3.0:1788752959.806956:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+26:2359:x1875643164848640:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752959.806987:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+26:2359:x1875643164848640:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752959.806994:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 128 00000100:00080000:3.0:1788752959.807040:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788752959.807048:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788752959.807062:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:3.0:1788752959.807071:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164848896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752959.807081:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:2359:x1875643164848768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 203us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752959.807094:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:3.0:1788752959.807104:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164848896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752959.807112:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:0.0:1788752959.807813:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164848512 00000100:00100000:0.0:1788752959.807822:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164848512 00000100:00100000:0.0:1788752959.807884:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 283 00000100:00100000:0.0:1788752959.807893:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164848512:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752959.807938:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164848512:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 46us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752959.807944:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 283 00010000:00010000:1.0:1788752960.426760:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788752960.746018:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788752960.746070:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788752960.746161:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9b98d61180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788752960.746166:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5bc3e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9b98d61480 00000020:00080000:0.0:1788752960.746170:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5bc3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9bb5aaac00 00000020:00080000:1.0:1788752960.746198:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788752960.746393:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788752960.758449:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788752960.758466:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1788752961.452425:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752962.474550:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752962.484834:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752962.484928:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164849152 00000100:00100000:3.0:1788752962.484939:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164849152 00000100:00100000:3.0:1788752962.485025:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00100000:3.0:1788752962.485036:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+13:10228:x1875643164849152:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788752962.485171:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+13:10228:x1875643164849152:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 135us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752962.485178:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 135 00000100:00080000:1.0:1788752962.485641:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752962.491008:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752962.491186:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164849408 00000100:00100000:0.0:1788752962.491203:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164849408 00000100:00100000:0.0:1788752962.491292:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:0.0:1788752962.491302:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+13:10228:x1875643164849408:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788752962.491933:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+14:10228:x1875643164849408:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 629us (938us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788752962.491941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00010000:00010000:1.0:1788752963.498269:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752963.754486:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182680320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752963.754591:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752963.754725:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680320 00000100:00100000:1.0:1788752963.754735:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680320 00000100:00100000:1.0:1788752963.754829:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788752963.754845:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182680320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788752963.754913:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752963.759813:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182680320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4957us (5206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752963.759832:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788752963.759911:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752963.764517:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788752963.764534:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788752963.764591:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182680320:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788752964.179057:0:12345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:49:23 (1788752963) 00010000:00010000:0.0:1788752964.523097:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788752964.714687:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752964.714706:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752964.715543:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788752964.715554:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788752964.782510:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788752964.782544:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba156a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182680448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788752964.782660:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752964.783250:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680448 00000100:00100000:0.0:1788752964.783263:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680448 00000100:00100000:0.0:1788752964.783357:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788752964.783371:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182680448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752964.783438:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752964.783532:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182680448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752964.783540:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788752964.783601:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788752964.783610:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788752964.783636:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9ba1576680, transno 4294967304 00000100:00100000:0.0:1788752964.783660:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba156a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182680448:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788752964.786042:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752964.786332:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182680704:0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.786517:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182680960:0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.786561:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752964.786631:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788752964.786638:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182680576:0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.786673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752964.786696:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182681088:0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.786731:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680960 00000100:00100000:3.0:1788752964.786740:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680960 00000100:00100000:3.0:1788752964.786800:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788752964.786813:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182680960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.786882:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182680960:12345-0@lo:400:kworker.0 Request processed in 71us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752964.786889:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788752964.786914:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680576 00000100:00100000:3.0:1788752964.786918:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680576 00000100:00100000:3.0:1788752964.786957:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788752964.786962:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182680576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.786993:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182680576:12345-0@lo:400:kworker.0 Request processed in 31us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752964.786999:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788752964.787061:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182680832:0@lo:400:kworker.0 00000100:00100000:2.0:1788752964.787968:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752964.788042:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752964.788090:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1574a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182680960:0@lo:400:kworker.0 00000100:00100000:2.0:1788752964.788113:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182680576:0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.790219:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752964.790452:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680704 00000100:00100000:0.0:1788752964.790467:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680704 00000100:00100000:0.0:1788752964.790541:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182681088 00000100:00100000:0.0:1788752964.790545:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182681088 00000100:00100000:0.0:1788752964.790576:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182680832 00000100:00100000:0.0:1788752964.790579:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182680832 00000100:00100000:0.0:1788752964.790610:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788752964.790622:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182680704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752964.790729:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf187800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182680704:12345-0@lo:400:kworker.0 Request processed in 110us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752964.790737:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788752964.790757:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788752964.790763:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182681088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752964.790803:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf187b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182681088:12345-0@lo:400:kworker.0 Request processed in 40us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752964.790809:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788752964.790820:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788752964.790827:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182680832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752964.790859:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182680832:12345-0@lo:400:kworker.0 Request processed in 32us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752964.790890:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1788752964.790911:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752964.790962:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf185180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182681088:0@lo:400:kworker.0 00000100:00100000:3.0:1788752964.792930:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182680832:0@lo:400:kworker.0 00000100:00100000:2.0:1788752964.793074:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1577b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182680704:0@lo:400:kworker.0 00000100:00100000:2.0:1788752964.919865:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752964.919920:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752964.920034:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752964.920075:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752964.920080:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164849664 00000100:00100000:3.0:1788752964.920153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164849536 00000100:00100000:3.0:1788752964.920166:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164849536 00000100:00100000:2.0:1788752964.920172:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752964.920227:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164849920 00000100:00100000:1.0:1788752964.920232:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164849920 00000100:00100000:1.0:1788752964.920284:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164849792 00000100:00100000:1.0:1788752964.920287:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164849792 00000100:00100000:1.0:1788752964.920329:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:1.0:1788752964.920340:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164849920:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752964.920441:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf184e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164849920:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 102us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752964.920462:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:1.0:1788752964.920482:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:1.0:1788752964.920489:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164849792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752964.920514:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf186a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164849792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752964.920520:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00080000:1.0:1788752964.920714:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752964.920719:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164849664 00000100:00080000:1.0:1788752964.920720:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788752964.920747:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752964.920763:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164850048 00000100:00100000:0.0:1788752964.920767:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164850048 00000100:00100000:1.0:1788752964.920788:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:0.0:1788752964.920793:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:1.0:1788752964.920807:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+14:2361:x1875643164849664:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752964.920824:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 285 00000100:00100000:3.0:1788752964.920832:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164849536:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752964.920846:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf186300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+14:2361:x1875643164849664:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 52us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752964.920853:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 132 00000100:00100000:3.0:1788752964.920860:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164849536:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752964.920866:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 285 00000100:00080000:1.0:1788752964.920904:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752964.924199:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164850048:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752964.924421:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf184380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164850048:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 3619us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752964.924434:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 133 00000100:00100000:1.0:1788752965.382077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752965.382274:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164850304 00000100:00100000:2.0:1788752965.382288:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164850304 00000100:00100000:2.0:1788752965.382368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:2.0:1788752965.382381:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+14:11293:x1875643164850304:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752965.386245:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752965.386300:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484906e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f127 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.387814:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.387840:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.387860:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.392403:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.392427:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.392440:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.393234:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f484906f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.393248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f484906f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.393256:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f484906f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752965.393270:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788752965.395751:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.395768:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.395789:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.395796:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752965.395800:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.395807:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.395823:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c9ba3667300) 00010000:00010000:2.0:1788752965.395826:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752965.395831:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.395837:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484906ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.396735:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.396742:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.396758:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.396765:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752965.396769:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.396793:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.396807:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c9b89426d00) 00010000:00010000:2.0:1788752965.396810:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752965.396815:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.396821:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484906f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.397612:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484906e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f127 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.397631:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f484906f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f127 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752965.397640:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:2.0:1788752965.397642:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752965.397645:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0a00, rc 0) 00000100:00100000:2.0:1788752965.397734:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+16:11293:x1875643164850304:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 15345us (15723us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788752965.399160:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 136 00000100:00100000:3.0:1788752965.403846:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752965.404652:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164850432 00000100:00100000:2.0:1788752965.404664:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164850432 00000100:00100000:2.0:1788752965.404715:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:2.0:1788752965.404736:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+16:11293:x1875643164850432:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788752965.404884:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+16:11293:x1875643164850432:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 160us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752965.404892:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:1.0:1788752965.406172:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752965.414511:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164850560 00000100:00100000:3.0:1788752965.414526:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164850560 00000100:00100000:3.0:1788752965.414618:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1788752965.414630:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+16:2359:x1875643164850560:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752965.414647:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752965.414675:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f484906f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f127 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752965.414698:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:3.0:1788752965.414717:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752965.414796:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+15:2359:x1875643164850560:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 168us (8628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752965.414804:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00010000:00010000:3.0:1788752965.546530:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788752965.738343:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752965.738353:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752965.738388:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788752965.738395:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:3.0:1788752965.848470:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1788752965.848495:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788752965.848522:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788752965.848534:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1788752966.570705:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752967.318290:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752967.319485:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164850688 00000100:00100000:0.0:1788752967.319499:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164850688 00000100:00100000:0.0:1788752967.319568:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00100000:0.0:1788752967.319590:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+13:11336:x1875643164850688:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752967.319609:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752967.319627:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f12e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319684:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319713:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319726:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319741:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319747:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319754:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319928:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319935:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319942:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319948:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752967.319953:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319960:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319971:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:0.0:1788752967.319978:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752967.319983:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.319990:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849070d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320001:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320006:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320012:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320017:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752967.320020:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320026:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320032:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c9b91646a00) 00010000:00010000:0.0:1788752967.320034:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752967.320037:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320042:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490714 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320069:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490706 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f12e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320090:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:0.0:1788752967.320093:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752967.320097:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f12e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.320106:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:0.0:1788752967.320189:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+13:11336:x1875643164850688:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 602us (1908us total) trans 0 rc 301/301 00000100:00100000:0.0:1788752967.320197:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 138 00000100:00080000:3.0:1788752967.320646:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752967.330874:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.331393:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164850944 00000100:00100000:2.0:1788752967.331404:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164850944 00000100:00100000:2.0:1788752967.331463:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 139 00000100:00100000:2.0:1788752967.331473:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+13:11336:x1875643164850944:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:2.0:1788752967.331532:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752967.331559:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490092 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef6e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.331591:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9ba3667400) 00010000:00010000:2.0:1788752967.331606:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752967.331818:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.331833:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.331842:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.331855:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.331862:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.331869:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752967.334566:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788752967.334592:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.334602:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.334609:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.334615:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752967.334619:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.334627:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.334643:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426800) 00010000:00010000:2.0:1788752967.334646:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752967.334651:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.334657:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f4849071b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788752967.334678:0:7899:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000026e59ef2 reply state 00000000f6d0324b transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752967.334688:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752967.334790:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+14:11336:x1875643164850944:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 3314us (3924us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788752967.334811:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 139 00010000:00010000:3.0:1788752967.340414:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.340433:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.340441:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.340447:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752967.340451:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.340459:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.340478:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c9b89426f00) 00010000:00010000:3.0:1788752967.340482:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752967.340486:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.340505:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490722 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752967.456755:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752967.457361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164851072 00000100:00100000:0.0:1788752967.457375:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164851072 00000100:00100000:0.0:1788752967.457445:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 140 00000100:00100000:0.0:1788752967.457456:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+13:11344:x1875643164851072:12345-192.168.203.5@tcp:101:lctl.0 00010000:00010000:0.0:1788752967.457483:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752967.457507:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f135 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.457587:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490730 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.457600:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.457612:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752967.457648:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788752967.457666:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752967.457704:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.457728:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f135 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.457745:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f135 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.457754:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:0.0:1788752967.457757:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788752967.457761:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9800, rc 0) 00000100:00100000:0.0:1788752967.457825:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+14:11344:x1875643164851072:12345-192.168.203.5@tcp:101:lctl.0 Request processed in 370us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752967.457833:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 140 00000100:00100000:2.0:1788752967.517458:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.517568:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164851200 00000100:00100000:3.0:1788752967.517588:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164851200 00000100:00100000:3.0:1788752967.517677:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:3.0:1788752967.517688:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+14:11350:x1875643164851200:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1788752967.517711:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752967.517739:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f13c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.517805:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.517821:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.517832:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.517846:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.517854:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.517861:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.517989:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849074c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518012:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849074c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518020:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849074c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752967.518052:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788752967.518067:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788752967.518090:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849074c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518105:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518111:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518119:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518187:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752967.518192:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518201:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518223:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:3.0:1788752967.518226:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752967.518231:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518246:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f4849073e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518260:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518266:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518272:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518277:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752967.518280:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518290:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518298:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c9ba049d300) 00010000:00010000:3.0:1788752967.518301:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752967.518303:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518309:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490745 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518339:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f13c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518353:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849074c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f13c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.518371:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752967.518373:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788752967.518376:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2cc00, rc 0) 00000100:00100000:3.0:1788752967.518448:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf186680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+15:11350:x1875643164851200:12345-192.168.203.5@tcp:101:bash.0 Request processed in 760us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752967.518455:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:1.0:1788752967.521847:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752967.523412:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164851456 00000100:00100000:0.0:1788752967.523429:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164851456 00000100:00100000:0.0:1788752967.523533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 142 00000100:00100000:0.0:1788752967.523545:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+15:11350:x1875643164851456:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1788752967.523569:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752967.523599:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490753 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f143 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.523738:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.523754:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.523786:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.523851:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.523859:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.523865:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788752967.524504:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788752967.524666:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524676:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524685:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524716:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524723:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524729:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524735:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752967.524745:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524754:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524765:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:0.0:1788752967.524769:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752967.524773:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524779:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f4849075a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752967.524791:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000cd16b96e reply state 00000000bd89517b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752967.524799:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788752967.524828:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490753 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524841:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.524848:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:0.0:1788752967.524850:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752967.524852:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173a00, rc 0) 00000100:00100000:0.0:1788752967.524931:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+18:11350:x1875643164851456:12345-192.168.203.5@tcp:101:bash.0 Request processed in 1389us (3097us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788752967.524939:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 142 00010000:00010000:3.0:1788752967.526834:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.526848:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.526855:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.526862:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752967.526866:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.526873:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.526888:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b91646800) 00010000:00010000:3.0:1788752967.526891:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752967.526895:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.526900:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490761 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752967.531217:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.531446:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164851584 00000100:00100000:3.0:1788752967.531457:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164851584 00000100:00100000:3.0:1788752967.531583:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:3.0:1788752967.531595:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164851584:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1788752967.531615:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752967.531640:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f14a expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788752967.531675:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788752967.531693:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788752967.531698:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752967.531708:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.531726:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.531740:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2ce00, rc 0) 00000100:00100000:3.0:1788752967.531806:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164851584:12345-192.168.203.5@tcp:101:bash.0 Request processed in 213us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752967.531813:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00080000:1.0:1788752967.532014:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788752967.534774:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.534871:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164851712 00000100:00100000:3.0:1788752967.534882:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164851712 00000100:00100000:3.0:1788752967.534984:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1788752967.534994:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+6:11350:x1875643164851712:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1788752967.535028:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752967.535048:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f151 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.535080:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.535089:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752967.535093:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752967.535099:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.535160:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.535174:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 7 pid: 6691 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752967.535187:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182681216:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752967.535285:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9180 going to sleep for 11 seconds 00000100:00100000:2.0:1788752967.538337:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752967.538432:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164851840 00000100:00100000:1.0:1788752967.538443:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164851840 00010000:00010000:1.0:1788752967.538486:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 8 pid: 6691 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752967.538530:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:1.0:1788752967.538540:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+8:2360:x1875643164851840:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752967.538557:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752967.538592:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 8 pid: 6691 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752967.538605:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 8 pid: 6691 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752967.538628:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752967.538633:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752967.538641:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752967.538674:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752967.538727:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752967.538741:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875643182681344:192.168.203.5@tcp:105: 00000100:00100000:1.0:1788752967.538812:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1788752967.539519:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf0ce1f4/0x80c8383f48490776 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f14a expref: 8 pid: 6691 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752967.539538:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182681216:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752967.539567:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.539600:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d600, rc 0) 00000100:00100000:3.0:1788752967.539653:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:11350:x1875643164851712:12345-192.168.203.5@tcp:101:bash.0 Request processed in 4660us (4887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752967.539661:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:2.0:1788752967.543856:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752967.543937:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164852096 00000100:00100000:0.0:1788752967.543949:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164852096 00000100:00100000:0.0:1788752967.544015:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:0.0:1788752967.544025:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+17:11350:x1875643164852096:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:3.0:1788752967.544705:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875643182681344:192.168.203.5@tcp:105: 00010000:00010000:3.0:1788752967.544726:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752967.544767:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf187100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+18:11350:x1875643164852096:12345-192.168.203.5@tcp:35:bash.0 Request processed in 743us (923us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788752967.544775:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:3.0:1788752967.545433:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164851840:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 6892us (7102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752967.545445:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00010000:00010000:0.0:1788752967.594620:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752967.637948:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.638022:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164852352 00000100:00100000:2.0:1788752967.638041:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164852352 00000100:00100000:2.0:1788752967.638182:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 143 00000100:00100000:2.0:1788752967.638196:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+18:11360:x1875643164852352:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752967.638243:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752967.638270:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f158 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752967.638391:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788752967.638554:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490784 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f158 expref: 20 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.638798:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:2.0:1788752967.638803:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788752967.638810:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f48490784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f158 expref: 20 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.638831:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0800, rc 0) 00000100:00100000:2.0:1788752967.638915:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+19:11360:x1875643164852352:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 721us (977us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788752967.638924:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 143 00000100:00100000:2.0:1788752967.641901:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752967.642011:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164852608 00000100:00100000:0.0:1788752967.642026:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164852608 00000100:00100000:0.0:1788752967.642114:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1788752967.642150:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+19:11360:x1875643164852608:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752967.642504:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+20:11360:x1875643164852608:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 357us (617us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788752967.642511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1788752967.710074:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.710270:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164852736 00000100:00100000:3.0:1788752967.710284:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164852736 00000100:00100000:3.0:1788752967.710359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 144 00000100:00100000:3.0:1788752967.710371:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+20:11366:x1875643164852736:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752967.710407:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752967.710436:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f15f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.710930:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.710948:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.710963:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752967.711045:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788752967.711050:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788752967.711075:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.711108:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f15f expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.711172:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f15f expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.711182:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752967.711185:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788752967.711190:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d200, rc 0) 00000100:00100000:3.0:1788752967.711275:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+21:11366:x1875643164852736:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 904us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752967.711283:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 144 00000100:00100000:1.0:1788752967.720461:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.720716:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164852992 00000100:00100000:2.0:1788752967.720732:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164852992 00000100:00100000:2.0:1788752967.720848:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:2.0:1788752967.720861:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+21:11366:x1875643164852992:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752967.720904:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752967.720936:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f484907a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f166 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.721077:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f484907a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.721094:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f484907a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.721110:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f484907a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752967.721153:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788752967.721339:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f484907a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f166 expref: 24 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.721362:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f484907a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f166 expref: 23 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.721372:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:2.0:1788752967.721375:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752967.721380:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0e00, rc 0) 00000100:00100000:2.0:1788752967.721466:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+23:11366:x1875643164852992:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 607us (1021us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788752967.721499:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:2.0:1788752967.726607:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.726750:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164853120 00000100:00100000:3.0:1788752967.726764:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164853120 00000100:00100000:3.0:1788752967.726913:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1788752967.726927:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+23:2360:x1875643164853120:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752967.726949:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752967.726982:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f484907a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f166 expref: 23 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.727009:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:3.0:1788752967.727045:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752967.727155:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf186d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+22:2360:x1875643164853120:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 198us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752967.727164:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:0.0:1788752967.728263:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.728411:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164853376 00000100:00100000:3.0:1788752967.728422:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164853376 00000100:00100000:3.0:1788752967.728506:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:3.0:1788752967.728517:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+22:11366:x1875643164853376:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752967.728547:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752967.728591:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484907b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f16d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.728731:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484907bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.728756:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484907bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.728772:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484907bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752967.728787:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788752967.728961:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f484907b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f16d expref: 25 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.728983:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484907bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f16d expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.728992:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:3.0:1788752967.729247:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788752967.729251:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80031a00, rc 0) 00000100:00100000:3.0:1788752967.729920:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+24:11366:x1875643164853376:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1400us (1659us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788752967.729932:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:1.0:1788752967.748586:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.748788:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164853504 00000100:00100000:2.0:1788752967.748801:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164853504 00000100:00100000:2.0:1788752967.748885:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:2.0:1788752967.748910:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164853504:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:2.0:1788752967.748986:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.749015:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.749026:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752967.749032:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752967.749038:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.749083:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.749100:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 6 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752967.749118:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf184a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875643182681472:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752967.749792:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18baa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788752967.760193:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.760339:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164853632 00000100:00100000:2.0:1788752967.760344:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf184a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1875643182681472:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752967.760356:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164853632 00010000:00010000:2.0:1788752967.760393:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1788752967.760447:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c9bb54b6d80 x1875643164853632/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:183/0 lens 504/0 e 0 to 0 dl 1788752978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788752967.760459:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bb54b6d80 with x1875643164853632 ext(0->12) 00010000:00010000:3.0:1788752967.760469:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 7 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.760487:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 7 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788752967.760495:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c9bb54b6d80 00000100:00100000:3.0:1788752967.760542:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:3.0:1788752967.760554:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164853632:12345-192.168.203.5@tcp:4:lfs.0 00000100:00100000:2.0:1788752967.762202:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164853632:12345-192.168.203.5@tcp:4:lfs.0 Request processed in 1642us (2009us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788752967.762216:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00002000:00100000:2.0:1788752967.762230:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c9bb54b6d80 x1875643164853632/t4294967305(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:183/0 lens 504/448 e 0 to 0 dl 1788752978 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788752967.762241:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bb54b6d80 with x1875643164853632 ext(0->12) 00010000:00010000:2.0:1788752967.762253:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 9 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.762269:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 9 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788752967.762277:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c9bb54b6d80 00000100:00100000:0.0:1788752967.767620:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.767842:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164853760 00000100:00100000:2.0:1788752967.767852:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164853760 00010000:00010000:2.0:1788752967.767889:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 9 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752967.767983:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:2.0:1788752967.767993:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164853760:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752967.768008:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788752967.768041:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788752967.768044:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788752967 00002000:00010000:2.0:1788752967.768047:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788752968 00002000:00010000:2.0:1788752967.768049:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788752967 00010000:00010000:2.0:1788752967.768055:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 9 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.768069:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 9 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.768091:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000519cd0b1/0x80c8383f4849077d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f151 expref: 9 pid: 6688 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.768108:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752967.768113:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752967.768181:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.768191:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.768217:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752967.768261:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164853760:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 270us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752967.768268:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00010000:00010000:0.0:1788752967.768325:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768335:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768366:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768386:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768394:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768401:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752967.768405:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768416:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768427:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.768442:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fc508cc/0x80c8383f484907ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752967.768486:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164853504:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 19581us (19935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752967.768494:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:1.0:1788752967.777022:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752967.777097:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164854016 00000100:00100000:0.0:1788752967.777109:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164854016 00000100:00100000:0.0:1788752967.777205:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:0.0:1788752967.777229:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f735450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+24:11366:x1875643164854016:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:0.0:1788752967.777293:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484907bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f16d expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752967.777586:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788752967.777634:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788752967.778159:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788752967.778212:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.778228:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.778237:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.778271:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.778286:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 28 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752967.778300:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875643182681600:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752967.778387:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0498240 going to sleep for 11 seconds 00000100:00100000:2.0:1788752967.784998:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1875643182681600:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752967.785054:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752967.786992:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.787966:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164854144 00000100:00100000:2.0:1788752967.787978:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164854144 00010000:00010000:2.0:1788752967.788029:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 29 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752967.788075:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:2.0:1788752967.788085:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+29:2359:x1875643164854144:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752967.788100:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752967.788106:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 29 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.788118:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 29 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.788187:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f143 expref: 29 pid: 5835 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.788214:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:2.0:1788752967.788220:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.788230:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.788239:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.788265:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752967.788345:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+28:2359:x1875643164854144:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 261us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752967.788353:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00010000:00010000:0.0:1788752967.788807:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.788816:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752967.788976:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788752967.789282:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788752967.789431:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182681728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788752967.789548:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752967.789594:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0498a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788752967.789942:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182681728 00000100:00100000:2.0:1788752967.789950:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182681728 00000100:00100000:2.0:1788752967.790002:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788752967.790010:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875643182681728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788752967.790090:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875643182681728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752967.790097:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788752967.790163:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752967.790363:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182681728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788752967.790906:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788752967.790974:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182681856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788752967.791021:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752967.791079:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba04986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752967.791701:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182681856 00000100:00100000:2.0:1788752967.791709:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182681856 00000100:00100000:2.0:1788752967.791779:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788752967.791788:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1875643182681856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788752967.791981:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1875643182681856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 193us (959us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788752967.791988:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788752967.792056:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1875643182681856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788752967.792105:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788752967.792159:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.792171:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.792179:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.792185:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752967.792190:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.792198:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.792237:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:0.0:1788752967.792240:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788752967.792246:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752967.792252:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484907d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788752967.792416:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788752967.792518:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788752967.792529:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367526405479ns, next at 368526403038ns, rc = 0 00000001:00080000:0.0:1788752967.792535:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788752967.792565:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:0.0:1788752967.792579:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788752967.792586:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484907bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f16d expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752967.792678:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f735450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+31:11366:x1875643164854016:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 15451us (15665us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788752967.792686:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00000020:00080000:0.0:1788752967.792690:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788752967.800395:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.800491:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164854272 00000100:00100000:3.0:1788752967.800501:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164854272 00000100:00100000:3.0:1788752967.800578:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:3.0:1788752967.800589:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+31:11366:x1875643164854272:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752967.800615:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752967.800638:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484907d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f174 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.800740:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484907d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f174 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.800755:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484907d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f174 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.800774:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752967.800777:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752967.800781:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80030600, rc 0) 00000100:00100000:3.0:1788752967.800842:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+32:11366:x1875643164854272:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 254us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752967.800849:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 147 00000100:00100000:1.0:1788752967.805745:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.805830:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164854528 00000100:00100000:3.0:1788752967.805843:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164854528 00000100:00100000:3.0:1788752967.805911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:3.0:1788752967.805923:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+32:11366:x1875643164854528:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1788752967.806497:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+33:11366:x1875643164854528:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 573us (755us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788752967.806507:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:1.0:1788752967.911233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.911295:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164854784 00000100:00100000:2.0:1788752967.911305:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164854784 00000100:00100000:2.0:1788752967.911410:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 148 00000100:00100000:2.0:1788752967.911421:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8733a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+33:11376:x1875643164854784:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752967.911444:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752967.911465:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f17b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752967.911580:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788752967.911705:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f17b expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.911720:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:2.0:1788752967.911723:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788752967.911728:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f17b expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.911743:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1e00, rc 0) 00000100:00100000:2.0:1788752967.913288:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8733a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+34:11376:x1875643164854784:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1863us (2056us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788752967.913298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 148 00000100:00100000:1.0:1788752967.920180:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752967.920392:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164854912 00000100:00100000:2.0:1788752967.920402:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164854912 00000100:00100000:2.0:1788752967.920463:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00100000:2.0:1788752967.920479:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+34:11376:x1875643164854912:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:2.0:1788752967.920556:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.920586:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.920598:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.920614:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.920636:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.920644:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.920744:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.920752:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923151:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788752967.923220:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923237:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923244:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923251:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923259:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752967.923263:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923271:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923303:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752967.923306:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752967.923312:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923318:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484907ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923338:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923345:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923350:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923355:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752967.923357:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923362:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923369:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b89426800) 00010000:00010000:2.0:1788752967.923371:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752967.923374:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923379:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f484907f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923407:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923414:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923420:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923425:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752967.923428:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923435:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923443:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:2.0:1788752967.923445:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752967.923448:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752967.923454:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484907fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752967.923638:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+34:11376:x1875643164854912:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 3162us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752967.923648:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 149 00000100:00100000:1.0:1788752967.936641:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752967.936759:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164855168 00000100:00100000:0.0:1788752967.936771:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164855168 00000100:00100000:0.0:1788752967.937142:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:0.0:1788752967.937156:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+34:11376:x1875643164855168:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752967.937432:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+35:11376:x1875643164855168:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 279us (799us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788752967.937457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:1.0:1788752967.988889:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752967.989006:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164855424 00000100:00100000:3.0:1788752967.989021:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164855424 00000100:00100000:3.0:1788752967.989096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:3.0:1788752967.989110:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+35:11379:x1875643164855424:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752967.989220:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752967.989248:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f182 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989355:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989517:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989536:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989557:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989565:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989581:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989734:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989743:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989751:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752967.989763:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788752967.989889:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989898:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989904:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989917:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752967.989922:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989930:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989944:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752967.989947:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752967.989952:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.989959:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490809 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992420:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992441:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992452:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992458:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752967.992463:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992472:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992519:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9ba049d300) 00010000:00010000:3.0:1788752967.992523:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752967.992529:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992536:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490810 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992638:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992658:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752967.992666:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752967.992668:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752967.992671:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d600, rc 0) 00000100:00100000:3.0:1788752967.992783:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+37:11379:x1875643164855424:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 3675us (3909us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788752967.992792:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:1.0:1788752968.001856:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752968.001962:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164855552 00000100:00100000:3.0:1788752968.001975:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164855552 00000100:00100000:3.0:1788752968.002059:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:3.0:1788752968.002071:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+37:11379:x1875643164855552:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1788752968.002308:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002332:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002374:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002413:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002421:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002429:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002436:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2ce00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752968.002453:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002462:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002478:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752968.002482:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788752968.002488:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.002495:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752968.002601:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+37:11379:x1875643164855552:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 531us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752968.002609:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:1.0:1788752968.010957:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752968.016729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164855808 00000100:00100000:2.0:1788752968.016750:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164855808 00000100:00100000:2.0:1788752968.016892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:2.0:1788752968.016926:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+37:11379:x1875643164855808:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:2.0:1788752968.017291:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+38:11379:x1875643164855808:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 366us (6348us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788752968.017300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:1.0:1788752968.278595:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752968.282933:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164856064 00000100:00100000:2.0:1788752968.282957:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164856064 00000100:00100000:2.0:1788752968.283068:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 152 00000100:00100000:2.0:1788752968.283080:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+38:11410:x1875643164856064:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:2.0:1788752968.283114:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752968.283172:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f4849082c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f189 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.283318:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.283338:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.283355:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752968.283369:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788752968.283617:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f4849082c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f189 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.283643:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f189 expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.283678:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:2.0:1788752968.283681:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752968.283686:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1800, rc 0) 00000100:00100000:2.0:1788752968.283788:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+40:11410:x1875643164856064:12345-192.168.203.5@tcp:101:cat.0 Request processed in 708us (5207us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788752968.283796:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 152 00000100:00100000:1.0:1788752968.290930:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752968.291037:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752968.291371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164856448 00000100:00100000:0.0:1788752968.291386:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164856448 00000100:00100000:0.0:1788752968.291480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:0.0:1788752968.291493:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+40:11410:x1875643164856448:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:0.0:1788752968.291915:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+41:11410:x1875643164856448:12345-192.168.203.5@tcp:35:cat.0 Request processed in 423us (876us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788752968.291923:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:3.0:1788752968.292176:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164856192 00000100:00100000:3.0:1788752968.292192:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164856192 00000100:00100000:3.0:1788752968.292244:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:3.0:1788752968.292252:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+41:2360:x1875643164856192:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752968.292268:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752968.292301:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f189 expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.292322:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752968.292329:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752968.292353:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+40:2360:x1875643164856192:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 102us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752968.292360:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1788752968.356912:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752968.357020:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164856704 00000100:00100000:3.0:1788752968.357035:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164856704 00000100:00100000:3.0:1788752968.357222:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 153 00000100:00100000:3.0:1788752968.357235:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+40:11416:x1875643164856704:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:3.0:1788752968.357270:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752968.357273:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788752968.357308:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f15f expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.357332:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752968.357339:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752968.357355:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490841 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f190 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.357739:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.357776:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.357786:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.357833:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.357849:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 40 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752968.357865:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182681984:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752968.358109:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752968.363493:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752968.363857:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164856832 00000100:00100000:0.0:1788752968.363871:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164856832 00010000:00010000:0.0:1788752968.363941:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 41 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752968.363991:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:0.0:1788752968.364004:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+41:2360:x1875643164856832:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752968.364025:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752968.364034:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 41 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.364052:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 41 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.364085:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:0.0:1788752968.364093:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.364153:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.364164:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.364196:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752968.364278:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+41:2360:x1875643164856832:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 276us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752968.364286:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00010000:00010000:3.0:1788752968.364838:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f48490817 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f182 expref: 40 pid: 5835 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752968.364864:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88a97100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182681984:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752968.364895:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.364907:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.364913:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752968.365078:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788752968.365551:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490841 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.365583:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.365593:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:2.0:1788752968.365596:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788752968.365600:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80030800, rc 0) 00000100:00100000:2.0:1788752968.365727:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+40:11416:x1875643164856704:12345-192.168.203.5@tcp:101:dd.0 Request processed in 8493us (8829us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788752968.365737:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 153 00000100:00100000:1.0:1788752968.370782:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752968.372071:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164857088 00000100:00100000:2.0:1788752968.372088:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164857088 00000100:00100000:2.0:1788752968.372421:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 154 00000100:00100000:2.0:1788752968.372435:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+40:11416:x1875643164857088:12345-192.168.203.5@tcp:36:dd.0 00010000:00010000:2.0:1788752968.372807:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.372831:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.372866:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788752968.372933:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788752968.372959:0:5834:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a1b5bb3c reply state 000000002f548043 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752968.372969:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752968.373106:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbddf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+43:11416:x1875643164857088:12345-192.168.203.5@tcp:36:dd.0 Request processed in 673us (2339us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788752968.373114:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 154 00000020:00080000:2.0:1788752968.373146:0:5834:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788752968.380889:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.380915:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.380924:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.380932:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752968.380938:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.380948:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.380971:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752968.380976:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752968.380983:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.380990:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.618490:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752968.635275:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752968.635662:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164857216 00000100:00100000:2.0:1788752968.635678:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164857216 00000100:00100000:2.0:1788752968.635770:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:2.0:1788752968.635784:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+42:11430:x1875643164857216:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:2.0:1788752968.635821:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752968.635854:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f4849085d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f197 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.635995:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636015:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636030:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636060:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636068:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636074:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636257:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636270:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636279:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636327:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.636345:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 43 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752968.636362:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf184a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182682112:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752968.636929:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0498240 going to sleep for 11 seconds 00000100:00100000:1.0:1788752968.649094:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752968.650359:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164857472 00000100:00100000:0.0:1788752968.650380:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164857472 00000100:00100000:0.0:1788752968.650504:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:0.0:1788752968.650518:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+44:5596:x1875643164857472:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788752968.651054:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+45:5596:x1875643164857472:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 534us (1972us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788752968.651063:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:2.0:1788752968.651241:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf184a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182682112:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752968.651279:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752968.654851:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752968.654969:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164857600 00000100:00100000:3.0:1788752968.654984:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164857600 00010000:00010000:3.0:1788752968.655044:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 45 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752968.655099:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:3.0:1788752968.655111:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+45:2360:x1875643164857600:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752968.655284:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752968.655294:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 45 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.655311:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 45 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.655343:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490848 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f190 expref: 45 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.655369:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752968.655376:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.655389:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.655399:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.655451:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752968.656292:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+44:2360:x1875643164857600:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1176us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752968.656305:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00010000:00010000:0.0:1788752968.656619:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656631:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752968.656703:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788752968.656709:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752968.656748:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656767:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656797:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656805:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656813:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656820:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752968.656825:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656834:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656853:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:0.0:1788752968.656857:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752968.656862:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656869:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656889:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656897:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656903:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656914:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752968.656917:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656923:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656931:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b89426800) 00010000:00010000:0.0:1788752968.656934:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752968.656937:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.656943:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849086b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.657001:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f4849085d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f197 expref: 44 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.657017:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f197 expref: 43 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.657025:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:0.0:1788752968.657027:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752968.657030:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0a00, rc 0) 00000100:00100000:0.0:1788752968.657099:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+43:11430:x1875643164857216:12345-192.168.203.5@tcp:101:stat.0 Request processed in 21318us (21840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752968.657107:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:3.0:1788752968.726456:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752968.729967:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164857856 00000100:00100000:0.0:1788752968.730020:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164857856 00000100:00100000:0.0:1788752968.730387:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 156 00000100:00100000:0.0:1788752968.730404:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+43:11436:x1875643164857856:12345-192.168.203.5@tcp:36:truncate.0 00010000:00010000:0.0:1788752968.730523:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752968.730572:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f197 expref: 43 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.730602:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:0.0:1788752968.730609:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788752968.732183:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.732355:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.732371:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752968.732466:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788752968.732497:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000007e971b59 reply state 00000000a0d4b3f7 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752968.732509:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788752968.732682:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+45:11436:x1875643164857856:12345-192.168.203.5@tcp:36:truncate.0 Request processed in 2278us (6237us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788752968.732693:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 156 00000020:00080000:0.0:1788752968.732701:0:5835:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788752968.736990:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.737013:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.737046:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.737052:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752968.737059:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.737068:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.737092:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752968.737096:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752968.737102:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752968.737108:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490879 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752968.874557:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182682240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752968.874688:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752968.875882:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182682240 00000100:00100000:1.0:1788752968.875900:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182682240 00000100:00100000:1.0:1788752968.876017:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788752968.876032:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182682240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788752968.876091:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752968.876236:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182682240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 206us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752968.876246:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788752968.876673:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf184a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182682240:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788752968.879339:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752968.881980:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752968.882715:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164857984 00000100:00100000:0.0:1788752968.882732:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164857984 00000100:00100000:0.0:1788752968.882944:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:0.0:1788752968.882957:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+44:11450:x1875643164857984:12345-192.168.203.5@tcp:101:stat.0 00010000:00010000:0.0:1788752968.882991:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752968.883027:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490880 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f19e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883170:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883189:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883211:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883230:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883237:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883243:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883366:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883375:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883407:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752968.883460:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788752968.883465:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752968.883491:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883505:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883527:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883535:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883543:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883550:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752968.883555:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883577:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883593:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:0.0:1788752968.883597:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752968.883602:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883621:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883640:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883645:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883651:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883655:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752968.883659:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883665:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883672:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b91646400) 00010000:00010000:0.0:1788752968.883674:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752968.883677:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883682:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f4849088e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883722:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490880 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883736:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752968.883751:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:0.0:1788752968.883753:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752968.883756:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752968.883866:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88a97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+45:11450:x1875643164857984:12345-192.168.203.5@tcp:101:stat.0 Request processed in 909us (1896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752968.883876:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 157 00000100:00100000:1.0:1788752968.962430:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752968.962647:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164858240 00000100:00100000:2.0:1788752968.962660:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164858240 00000100:00100000:2.0:1788752968.962746:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00100000:2.0:1788752968.962760:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+45:11460:x1875643164858240:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752968.962798:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752968.962829:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849089c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1a5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752968.962980:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788752968.963206:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849089c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1a5 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.963223:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:2.0:1788752968.963226:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788752968.963233:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849089c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1a5 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752968.963250:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1a00, rc 0) 00000100:00100000:2.0:1788752968.963334:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+46:11460:x1875643164858240:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 577us (922us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788752968.963341:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 158 00000100:00100000:1.0:1788752968.967055:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752968.967180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164858496 00000100:00100000:0.0:1788752968.967194:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164858496 00000100:00100000:0.0:1788752968.967285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:0.0:1788752968.967297:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+46:11460:x1875643164858496:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752968.967647:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+47:11460:x1875643164858496:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 351us (608us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788752968.967655:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:3.0:1788752969.027934:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752969.028340:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164858752 00000100:00100000:2.0:1788752969.028356:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164858752 00000100:00100000:2.0:1788752969.028477:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:2.0:1788752969.028491:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+47:11466:x1875643164858752:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1788752969.028569:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752969.028599:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484908aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1ac expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.028743:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.028762:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.028773:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.028818:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.028834:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 48 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752969.028851:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf184700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182682368:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752969.028988:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0498600 going to sleep for 11 seconds 00000100:00080000:1.0:1788752969.030724:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752969.031950:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf184700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182682368:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752969.031988:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752969.032755:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.032950:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164858880 00000100:00100000:0.0:1788752969.032960:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164858880 00010000:00010000:0.0:1788752969.033014:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 49 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752969.033067:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:0.0:1788752969.033079:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+49:2361:x1875643164858880:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752969.033098:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752969.033106:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 49 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.033120:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 49 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.033226:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f19e expref: 49 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.033246:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:0.0:1788752969.033252:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.033264:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.033274:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.033311:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752969.033379:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+48:2361:x1875643164858880:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 301us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.033387:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00010000:00010000:2.0:1788752969.034099:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.034112:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752969.034189:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788752969.034426:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484908aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 49 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.034450:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 48 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.034460:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:2.0:1788752969.034464:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788752969.034467:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1400, rc 0) 00000100:00100000:2.0:1788752969.034718:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+48:11466:x1875643164858752:12345-192.168.203.5@tcp:101:bash.0 Request processed in 6229us (6801us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788752969.034727:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 159 00000100:00100000:3.0:1788752969.039862:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752969.040476:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164859136 00000100:00100000:2.0:1788752969.040492:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164859136 00000100:00100000:2.0:1788752969.040719:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 160 00000100:00100000:2.0:1788752969.040730:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+48:11466:x1875643164859136:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:2.0:1788752969.041113:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.041184:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.041209:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788752969.041276:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788752969.041325:0:5834:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000eb22c83b reply state 00000000dae94649 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752969.041336:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752969.041481:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+51:11466:x1875643164859136:12345-192.168.203.5@tcp:36:bash.0 Request processed in 751us (1640us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788752969.041490:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 160 00000020:00080000:2.0:1788752969.041497:0:5834:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788752969.043771:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.043794:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.043804:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.043811:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752969.043818:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.043853:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.043875:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:1.0:1788752969.043879:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752969.043885:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.043892:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484908bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752969.048301:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752969.048846:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164859264 00000100:00100000:2.0:1788752969.048861:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164859264 00000100:00100000:2.0:1788752969.048934:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 161 00000100:00100000:2.0:1788752969.048945:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+50:11466:x1875643164859264:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1788752969.048978:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752969.049006:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f484908c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1b3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.049118:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.049168:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 51 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.049179:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.049235:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 51 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.049252:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 51 pid: 7899 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752969.049289:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf184700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182682496:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752969.052771:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788752969.053999:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf184700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182682496:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752969.054040:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752969.054405:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752969.054496:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164859392 00000100:00100000:2.0:1788752969.054724:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164859392 00010000:00010000:2.0:1788752969.054784:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 52 pid: 7899 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752969.054831:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:2.0:1788752969.054844:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+52:2360:x1875643164859392:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752969.054869:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752969.054878:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 52 pid: 7899 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.054894:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 52 pid: 7899 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.054926:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f484908b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ac expref: 52 pid: 7899 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.054951:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:2.0:1788752969.054957:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.054994:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.055005:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.055098:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752969.055245:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+51:2360:x1875643164859392:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 402us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752969.055254:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00010000:00010000:0.0:1788752969.056779:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.056798:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752969.056950:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788752969.056956:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752969.056991:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.057051:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f484908c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1b3 expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.057079:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1b3 expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.057091:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:1.0:1788752969.057094:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752969.057098:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1c00, rc 0) 00000100:00100000:1.0:1788752969.057226:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+50:11466:x1875643164859264:12345-192.168.203.5@tcp:101:bash.0 Request processed in 8281us (8940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752969.057235:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 161 00000100:00100000:3.0:1788752969.060054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.060240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164859648 00000100:00100000:0.0:1788752969.060254:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164859648 00000100:00100000:0.0:1788752969.060329:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:0.0:1788752969.060341:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+50:11466:x1875643164859648:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:0.0:1788752969.060668:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+51:11466:x1875643164859648:12345-192.168.203.5@tcp:35:bash.0 Request processed in 328us (627us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788752969.060692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:3.0:1788752969.131703:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.131956:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164859904 00000100:00100000:0.0:1788752969.131971:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164859904 00000100:00100000:0.0:1788752969.132075:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 162 00000100:00100000:0.0:1788752969.132087:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+51:11476:x1875643164859904:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752969.132170:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752969.132207:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484908d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1ba expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752969.132337:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788752969.132504:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484908d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ba expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.132521:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:0.0:1788752969.132525:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788752969.132530:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484908d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1ba expref: 53 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.132547:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752969.132650:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+52:11476:x1875643164859904:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 565us (968us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788752969.132658:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 162 00000100:00100000:3.0:1788752969.136386:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.136466:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164860032 00000100:00100000:0.0:1788752969.136480:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164860032 00000100:00100000:0.0:1788752969.136551:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:0.0:1788752969.136656:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+52:11476:x1875643164860032:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:0.0:1788752969.136859:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.136881:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.136895:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.136912:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.136920:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.136928:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137050:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137061:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137069:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752969.137339:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137361:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137382:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137390:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137397:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752969.137402:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137411:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137428:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:0.0:1788752969.137431:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752969.137439:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137446:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484908e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137464:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137471:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137478:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137484:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752969.137493:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137501:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137509:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b91646400) 00010000:00010000:0.0:1788752969.137512:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752969.137515:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137521:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484908e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137540:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137545:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137551:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137556:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752969.137839:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137848:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137857:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:0.0:1788752969.137859:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752969.137870:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.137875:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484908f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752969.138107:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+52:11476:x1875643164860032:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 1541us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752969.141153:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 163 00000100:00100000:3.0:1788752969.142289:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.146765:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164860288 00000100:00100000:0.0:1788752969.146790:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164860288 00000100:00100000:0.0:1788752969.146954:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:0.0:1788752969.146969:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+52:11476:x1875643164860288:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752969.147401:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+53:11476:x1875643164860288:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 433us (5118us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788752969.147410:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:1.0:1788752969.183437:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.183568:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164860544 00000100:00100000:3.0:1788752969.183585:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164860544 00000100:00100000:3.0:1788752969.183672:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 164 00000100:00100000:3.0:1788752969.183686:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+53:11479:x1875643164860544:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752969.183723:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752969.183751:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484908f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1c1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.183900:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.183922:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.183939:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.183958:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.183966:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.183974:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.184831:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849090c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.184848:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849090c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.184875:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849090c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752969.184890:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788752969.185038:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185047:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185055:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185062:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752969.185067:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185076:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185091:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752969.185095:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752969.185101:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185107:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484908fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185344:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185352:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185368:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185373:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752969.185377:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185384:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185394:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9ba049d300) 00010000:00010000:3.0:1788752969.185397:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752969.185401:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185407:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185484:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f484908f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1c1 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185501:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849090c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1c1 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.185510:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:3.0:1788752969.185512:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752969.185514:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d600, rc 0) 00000100:00100000:3.0:1788752969.185628:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+55:11479:x1875643164860544:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1944us (2205us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788752969.185651:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 164 00000100:00100000:3.0:1788752969.189409:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.189466:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752969.189514:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164860672 00000100:00100000:1.0:1788752969.189530:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164860672 00000100:00100000:0.0:1788752969.189541:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164860800 00000100:00100000:0.0:1788752969.189548:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164860800 00000100:00100000:0.0:1788752969.189625:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:1.0:1788752969.189628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:0.0:1788752969.189637:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+56:2360:x1875643164860800:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788752969.189645:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+56:11479:x1875643164860672:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1788752969.189659:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752969.189694:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f4849090c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1c1 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.189718:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:1.0:1788752969.189723:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.189723:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752969.189742:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.189755:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.189789:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752969.189789:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+55:2360:x1875643164860800:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 153us (320us total) trans 0 rc 0/0 00010000:00010000:1.0:1788752969.189805:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752969.189812:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00010000:00010000:1.0:1788752969.189816:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.189825:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752969.189830:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.189839:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.189871:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:1.0:1788752969.189874:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752969.189879:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.189887:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f4849091a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752969.189928:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+54:11479:x1875643164860672:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 290us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752969.189937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 165 00000100:00100000:0.0:1788752969.192068:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752969.192267:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164861056 00000100:00100000:1.0:1788752969.192280:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164861056 00000100:00100000:1.0:1788752969.192339:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1788752969.192347:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+54:11479:x1875643164861056:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1788752969.192864:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+55:11479:x1875643164861056:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 516us (807us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788752969.192871:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1788752969.326100:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.327075:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164861312 00000100:00100000:0.0:1788752969.327112:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164861312 00000100:00100000:0.0:1788752969.327248:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 166 00000100:00100000:0.0:1788752969.327261:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+55:11497:x1875643164861312:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1788752969.327301:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752969.327336:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490921 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1c8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.327480:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490928 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.327503:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.327520:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752969.327535:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788752969.327722:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490921 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1c8 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.327745:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1c8 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.327755:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:0.0:1788752969.327758:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788752969.327762:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173400, rc 0) 00000100:00100000:0.0:1788752969.327842:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+57:11497:x1875643164861312:12345-192.168.203.5@tcp:101:cat.0 Request processed in 584us (1759us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788752969.327850:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 166 00000100:00100000:3.0:1788752969.368645:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752969.368774:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164861440 00000100:00100000:1.0:1788752969.368787:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164861440 00000100:00100000:1.0:1788752969.368865:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:1.0:1788752969.368878:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+57:11498:x1875643164861440:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752969.368915:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752969.368943:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1cf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.369307:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849093d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.369327:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849093d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.369343:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849093d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752969.369393:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788752969.369398:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752969.369421:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849093d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.369458:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1cf expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.369486:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849093d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1cf expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.369496:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:1.0:1788752969.369500:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788752969.369504:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270600, rc 0) 00000100:00100000:1.0:1788752969.369662:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+58:11498:x1875643164861440:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 785us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752969.369672:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 167 00000100:00100000:1.0:1788752969.373775:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.373887:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164861824 00000100:00100000:0.0:1788752969.373904:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164861824 00000100:00100000:0.0:1788752969.373994:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:0.0:1788752969.374007:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+58:11498:x1875643164861824:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752969.374942:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+59:11498:x1875643164861824:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 932us (1182us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788752969.374954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:3.0:1788752969.381829:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752969.382032:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164861952 00000100:00100000:2.0:1788752969.382058:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164861952 00000100:00100000:2.0:1788752969.382205:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1788752969.382220:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+59:11498:x1875643164861952:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:2.0:1788752969.382246:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788752969.382283:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f484908cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1b3 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.382313:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1c8 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.382330:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484907d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f174 expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.382345:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9ba049d000) 00010000:00010000:2.0:1788752969.382359:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752969.382444:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+56:11498:x1875643164861952:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 227us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752969.382472:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:3.0:1788752969.385866:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.386042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164862080 00000100:00100000:0.0:1788752969.386070:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164862080 00000100:00100000:0.0:1788752969.386386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:0.0:1788752969.386404:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+56:11498:x1875643164862080:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:0.0:1788752969.386617:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.386641:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.386656:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788752969.387012:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788752969.387532:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+56:11498:x1875643164862080:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 1131us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.387543:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 168 00000100:00100000:0.0:1788752969.423945:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752969.424116:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164862208 00000100:00100000:2.0:1788752969.424173:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164862208 00000100:00100000:2.0:1788752969.424662:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 169 00000100:00100000:2.0:1788752969.424675:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+56:11500:x1875643164862208:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752969.424814:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752969.424844:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f4849094b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.424935:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.424955:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.424969:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.424989:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.424997:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425004:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425116:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425298:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425306:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752969.425355:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788752969.425360:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752969.425383:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425397:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425591:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425598:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425605:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425612:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752969.425616:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425625:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425639:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752969.425642:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752969.425655:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425662:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490952 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425679:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425685:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425691:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425697:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752969.425700:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425705:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425714:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b89426e00) 00010000:00010000:2.0:1788752969.425717:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752969.425720:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425727:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490959 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425770:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f4849094b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425799:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.425807:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:2.0:1788752969.425809:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752969.425812:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0400, rc 0) 00000100:00100000:2.0:1788752969.425984:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+57:11500:x1875643164862208:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1310us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752969.425995:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 169 00010000:00010000:3.0:1788752969.644456:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788752969.836019:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752969.836030:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752969.836069:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788752969.836075:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788752969.836240:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b9091fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182682624:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788752969.836352:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b85770e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752969.854748:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.856346:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164862336 00000100:00100000:3.0:1788752969.856360:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164862336 00000100:00100000:3.0:1788752969.856418:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:3.0:1788752969.856428:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164862336:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788752969.856460:0:5835:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788752969.856584:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164862336:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 156us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752969.856592:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 170 00000100:00100000:1.0:1788752969.857864:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b9091fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182682624:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788752969.863682:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752969.863854:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164862464 00000100:00100000:2.0:1788752969.863867:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164862464 00000100:00100000:2.0:1788752969.863932:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:2.0:1788752969.863945:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b9091fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+57:11511:x1875643164862464:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788752969.864024:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864045:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864060:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864079:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864085:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864110:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864168:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864176:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864182:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752969.864292:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788752969.864297:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752969.864311:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864324:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864331:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864337:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864344:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752969.864349:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864356:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864376:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:2.0:1788752969.864379:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752969.864386:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864392:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1c00/0x80c8383f48490967 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864404:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864409:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864415:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864420:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752969.864422:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864427:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864433:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9c9b89426e00) 00010000:00010000:2.0:1788752969.864435:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752969.864437:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864442:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f4849096e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864475:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864482:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864488:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864492:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752969.864495:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864501:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864508:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:2.0:1788752969.864510:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752969.864513:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752969.864519:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752969.865190:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b9091fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+57:11511:x1875643164862464:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 1244us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752969.865200:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 171 00000100:00100000:3.0:1788752969.872068:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.872160:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164862720 00000100:00100000:0.0:1788752969.872173:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164862720 00000100:00100000:0.0:1788752969.872236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:0.0:1788752969.872247:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+57:11511:x1875643164862720:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752969.872271:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752969.872294:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849097c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1dd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872428:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872445:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872459:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752969.872473:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788752969.872602:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872611:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872619:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872626:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752969.872638:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872647:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872662:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:0.0:1788752969.872666:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788752969.872672:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872679:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490983 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872725:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849097c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1dd expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872748:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:0.0:1788752969.872752:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788752969.872755:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849097c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1dd expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.872766:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173000, rc 0) 00000100:00100000:0.0:1788752969.872832:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164862720:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 587us (779us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788752969.872841:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 172 00000100:00100000:2.0:1788752969.878699:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.878784:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164862848 00000100:00100000:3.0:1788752969.878796:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164862848 00000100:00100000:3.0:1788752969.878859:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:3.0:1788752969.878869:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164862848:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788752969.878913:0:5834:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788752969.879032:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf184700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164862848:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 164us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752969.879041:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 173 00000100:00100000:2.0:1788752969.884460:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.884732:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164863104 00000100:00100000:3.0:1788752969.884753:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164863104 00000100:00100000:3.0:1788752969.884807:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:3.0:1788752969.884817:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164863104:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788752969.884837:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752969.884840:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788752969.884872:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f4849093d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1cf expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.884895:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752969.884900:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752969.884914:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490991 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1e4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788752969.885736:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788752969.885969:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.885986:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.885998:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.886064:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2ce00/0x80c8383f48490991 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1e4 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.886082:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1e4 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.886107:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9ba049d300) 00010000:00010000:3.0:1788752969.886110:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752969.886114:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9ba3b2d200, rc 0) 00000100:00100000:2.0:1788752969.890780:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+59:11511:x1875643164863104:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 5950us (6319us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788752969.890813:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 174 00000100:00100000:0.0:1788752969.896109:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.896245:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164863360 00000100:00100000:3.0:1788752969.896261:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164863360 00000100:00100000:3.0:1788752969.896336:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 175 00000100:00100000:3.0:1788752969.896348:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+59:11511:x1875643164863360:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752969.896424:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752969.896458:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d200/0x80c8383f48490998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1e4 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896480:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9ba049d300) 00010000:00010000:3.0:1788752969.896491:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752969.896515:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896531:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896541:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896571:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896579:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896606:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896684:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896691:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896698:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896704:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752969.896709:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896717:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896726:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752969.896729:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752969.896734:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896740:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2d600/0x80c8383f484909a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896752:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896759:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896771:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896776:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752969.896779:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896785:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896793:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfcf3d930 (ffff9c9ba049df00) 00010000:00010000:3.0:1788752969.896795:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752969.896797:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.896803:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfcf3d930 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752969.896898:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164863360:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 552us (804us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788752969.896906:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 175 00000004:00080000:0.0:1788752969.898724:0:8075:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369632597878ns, next at 370632595018ns, rc = 0 00000100:00100000:3.0:1788752969.898805:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182682752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752969.898885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752969.899034:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182683136:0@lo:400:kworker.0 00000100:00100000:1.0:1788752969.899072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752969.899169:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788752969.899176:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182683264:0@lo:400:kworker.0 00000100:00100000:1.0:1788752969.899203:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752969.899342:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182683264 00000100:00100000:3.0:1788752969.899352:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182683264 00000100:00100000:3.0:1788752969.899418:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788752969.899430:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182683264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752969.899492:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182683264:12345-0@lo:400:kworker.0 Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752969.899519:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788752969.899875:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182683264:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.900545:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182682752 00000100:00100000:0.0:1788752969.900572:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182682752 00000100:00100000:0.0:1788752969.900624:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788752969.900633:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182682752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752969.900668:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752969.900738:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875643182682752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.900746:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788752969.900777:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb5bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182682880:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.900814:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752969.900849:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182683392:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.900876:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752969.900900:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788752969.900907:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182683008:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.900927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752969.900942:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182683520:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.900965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788752969.900991:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752969.901010:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182682880 00000100:00100000:0.0:1788752969.901014:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182682880 00000100:00100000:0.0:1788752969.901036:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788752969.901043:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182682880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.901078:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182682880:12345-0@lo:400:kworker.0 Request processed in 35us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.901085:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788752969.901159:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb5bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182682880:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.901204:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182682752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752969.901234:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182683136 00000100:00100000:0.0:1788752969.901237:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182683136 00000100:00080000:0.0:1788752969.901253:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752969.901278:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182683392 00000100:00100000:0.0:1788752969.901281:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182683392 00000100:00100000:0.0:1788752969.901300:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182683008 00000100:00100000:0.0:1788752969.901303:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182683008 00000100:00100000:0.0:1788752969.901317:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788752969.901323:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182683136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.901360:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182683136:12345-0@lo:400:kworker.0 Request processed in 37us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.901366:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788752969.901377:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788752969.901382:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182683392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.901413:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182683392:12345-0@lo:400:kworker.0 Request processed in 30us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.901419:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788752969.901430:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788752969.901436:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182683008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.901461:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182683008:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.901466:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1788752969.901479:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752969.901501:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182683008:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.901512:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182683392:0@lo:400:kworker.0 00000100:00100000:3.0:1788752969.902378:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182683520 00000100:00100000:3.0:1788752969.902386:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182683520 00000100:00100000:3.0:1788752969.902423:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788752969.902431:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182683520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752969.902497:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182683520:12345-0@lo:400:kworker.0 Request processed in 67us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752969.902505:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788752969.902564:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182683136:0@lo:400:kworker.0 00000100:00100000:1.0:1788752969.905923:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182683520:0@lo:400:kworker.0 00000100:00100000:0.0:1788752969.908321:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.909328:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164863488 00000100:00100000:0.0:1788752969.909341:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164863488 00000100:00100000:0.0:1788752969.909406:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 176 00000100:00100000:0.0:1788752969.909417:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+58:11511:x1875643164863488:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752969.909443:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752969.909473:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484909b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.909522:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.909538:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.909552:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.909690:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484909b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.909710:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.909719:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:0.0:1788752969.909722:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788752969.909726:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:0.0:1788752969.909793:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+59:11511:x1875643164863488:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 378us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.909800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 176 00000100:00100000:3.0:1788752969.920389:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.920435:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164863744 00000100:00100000:3.0:1788752969.920447:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164863744 00000100:00100000:3.0:1788752969.920510:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 177 00000100:00100000:3.0:1788752969.920521:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+59:11511:x1875643164863744:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752969.920647:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.920667:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.920680:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788752969.921004:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788752969.921015:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369654891417ns, next at 370654889242ns, rc = 0 00000004:00010000:3.0:1788752969.921112:0:5834:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000e8ed87a0 reply state 0000000016c6b09f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752969.921176:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788752969.921282:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+61:11511:x1875643164863744:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 761us (905us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788752969.921289:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 177 00010000:00010000:1.0:1788752969.927349:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.927372:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.927382:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.927389:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752969.927395:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.927406:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.927430:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:1.0:1788752969.927434:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788752969.927440:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752969.927447:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f484909c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752969.928069:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.929980:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164863872 00000100:00100000:0.0:1788752969.929998:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164863872 00000100:00100000:0.0:1788752969.930067:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 178 00000100:00100000:0.0:1788752969.930080:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+60:11511:x1875643164863872:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752969.930111:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752969.930166:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1f2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.930358:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.930377:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.930403:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:0.0:1788752969.930406:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788752969.930410:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8e00, rc 0) 00000100:00100000:0.0:1788752969.930491:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+61:11511:x1875643164863872:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 414us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.930498:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 178 00000100:00100000:1.0:1788752969.947917:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.951828:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164864000 00000100:00100000:3.0:1788752969.951849:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164864000 00000100:00100000:2.0:1788752969.954442:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:2.0:1788752969.954455:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164864000:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788752969.954782:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164864000:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 328us (6874us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788752969.954790:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00080000:0.0:1788752969.956456:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752969.964251:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.964544:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164864256 00000100:00100000:0.0:1788752969.964567:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164864256 00000100:00100000:0.0:1788752969.964644:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:0.0:1788752969.964656:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+61:11511:x1875643164864256:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788752969.966377:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+62:11511:x1875643164864256:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1714us (2132us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788752969.966400:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:3.0:1788752969.976239:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.976276:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164864512 00000100:00100000:3.0:1788752969.976285:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164864512 00000100:00100000:3.0:1788752969.976337:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:3.0:1788752969.976347:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+62:11511:x1875643164864512:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788752969.976478:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+62:11511:x1875643164864512:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 131us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752969.976487:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 179 00000100:00100000:1.0:1788752969.980850:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752969.981344:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164864640 00000100:00100000:0.0:1788752969.981356:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164864640 00000100:00100000:0.0:1788752969.981417:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 180 00000100:00100000:0.0:1788752969.981429:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+62:11511:x1875643164864640:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752969.981451:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752969.981472:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484909d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f1f9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.981547:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484909d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.981576:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484909d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.981589:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484909d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752969.981627:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788752969.981643:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484909d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.981669:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f484909d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f9 expref: 64 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.981686:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484909d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f9 expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752969.981695:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:0.0:1788752969.981706:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788752969.981709:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173000, rc 0) 00000100:00100000:0.0:1788752969.982198:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+63:11511:x1875643164864640:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 761us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752969.982206:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 180 00000100:00100000:1.0:1788752969.991054:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752969.991386:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164864768 00000100:00100000:3.0:1788752969.991400:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164864768 00000100:00100000:3.0:1788752969.991451:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1788752969.991463:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164864768:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788752969.991484:0:9256:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752969.991510:0:9256:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f200 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788752969.991542:0:9256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e344a, blocks: 0x1 00010000:00010000:3.0:1788752969.991577:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1788752969.991591:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752969.991601:0:9256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 8 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.991623:0:9256:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 8 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752969.991637:0:9256:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80031a00, rc 0) 00000100:00100000:3.0:1788752969.991707:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164864768:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 245us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752969.991714:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1788752970.001295:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.001335:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865024 00000100:00100000:3.0:1788752970.001346:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865024 00000100:00100000:3.0:1788752970.001403:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 181 00000100:00100000:3.0:1788752970.001414:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+63:11511:x1875643164865024:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788752970.001536:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+63:11511:x1875643164865024:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 123us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752970.001544:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 181 00000100:00100000:2.0:1788752970.012223:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752970.012263:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865152 00000100:00100000:2.0:1788752970.012274:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865152 00000100:00100000:2.0:1788752970.012334:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:2.0:1788752970.012345:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+8:11511:x1875643164865152:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788752970.012365:0:12054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752970.012383:0:12054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f207 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.012422:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 9 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.012431:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752970.012436:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752970.012441:0:12054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 9 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.012482:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 9 pid: 9256 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.012515:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 9 pid: 9256 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752970.012531:0:12054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf185f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12054:1875643182683648:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752970.012637:0:12054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b94e9d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788752970.017678:0:12054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf185f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12054:1875643182683648:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752970.019115:0:12054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 9 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.019345:0:12054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1a00, rc 0) 00000100:00100000:2.0:1788752970.019598:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752970.021200:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf184000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+9:11511:x1875643164865152:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 8846us (8979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752970.021212:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000001:00080000:3.0:1788752970.023548:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1788752970.023583:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1788752970.024915:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865280 00000100:00100000:1.0:1788752970.024930:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865280 00010000:00010000:1.0:1788752970.025049:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 9 pid: 9256 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752970.025154:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:1.0:1788752970.025165:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164865280:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752970.025181:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752970.025214:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 9 pid: 9256 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.025229:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 9 pid: 9256 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.025255:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000922ad32b/0x80c8383f484909de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f200 expref: 9 pid: 9256 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.025278:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752970.025283:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752970.025292:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 8 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.025317:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 8 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.025359:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 8 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752970.025375:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1563480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875643182683776:192.168.203.5@tcp:105: 00000100:00100000:1.0:1788752970.025465:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788752970.034001:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752970.034104:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1563480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875643182683776:192.168.203.5@tcp:105: 00010000:00010000:1.0:1788752970.034173:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752970.034249:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164865280:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 9085us (14651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752970.034264:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1788752970.034444:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865408 00000100:00100000:0.0:1788752970.034453:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865408 00002000:00100000:0.0:1788752970.034505:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c9baf187480 x1875643164865408/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:186/0 lens 504/0 e 0 to 0 dl 1788752981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752970.034516:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9baf187480 with x1875643164865408 ext(0->8) 00002000:00010000:0.0:1788752970.034522:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9baf187480 00000100:00100000:0.0:1788752970.034633:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:0.0:1788752970.034643:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164865408:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788752970.035110:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf187480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+10:2361:x1875643164865408:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 468us (1120us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788752970.035118:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00002000:00100000:0.0:1788752970.035158:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c9baf187480 x1875643164865408/t4294967314(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:186/0 lens 504/448 e 0 to 0 dl 1788752981 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752970.035168:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9baf187480 with x1875643164865408 ext(0->8) 00002000:00010000:0.0:1788752970.035172:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9baf187480 00000100:00100000:3.0:1788752970.037745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.037789:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.037821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.037853:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865792 00000100:00100000:3.0:1788752970.037865:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865792 00000100:00100000:3.0:1788752970.037930:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:3.0:1788752970.037941:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164865792:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752970.038015:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2359:x1875643164865792:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752970.038023:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 137 00000100:00100000:3.0:1788752970.038043:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865664 00000100:00100000:3.0:1788752970.038046:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865664 00000100:00100000:3.0:1788752970.038071:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:3.0:1788752970.038078:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164865664:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752970.038103:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164865664:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752970.038109:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:1.0:1788752970.039392:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865536 00000100:00100000:1.0:1788752970.039402:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865536 00000100:00080000:3.0:1788752970.039588:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788752970.039594:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752970.040074:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:1.0:1788752970.040086:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164865536:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752970.040540:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2359:x1875643164865536:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 456us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752970.040550:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 287 00000100:00100000:3.0:1788752970.050417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752970.050611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164865920 00000100:00100000:0.0:1788752970.050622:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164865920 00000100:00100000:0.0:1788752970.050684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 182 00000100:00100000:0.0:1788752970.050695:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+63:11511:x1875643164865920:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788752970.109007:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788752970.109022:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788752970.109070:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788752970.109082:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9ba0498a80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788752970.109087:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9baef55900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9ba04989c0 00000020:00080000:3.0:1788752970.109091:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9baef55200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9bb5aa0000 00000004:00080000:3.0:1788752970.109269:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788752970.109453:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788752970.109672:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788752970.109747:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182683904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788752970.109831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752970.109899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788752970.109907:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9b88b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182684032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788752970.109932:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752970.109966:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182683904 00000100:00100000:3.0:1788752970.109974:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182683904 00000100:00100000:3.0:1788752970.110020:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182684032 00000100:00100000:3.0:1788752970.110023:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182684032 00000100:00100000:3.0:1788752970.110060:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788752970.110070:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182683904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788752970.110102:0:9256:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1788752970.110178:0:9256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9e3447, atime: 0x6a9e3448, ctime: 0x6a9e3447, blocks: 0xb 00010000:00010000:3.0:1788752970.110190:0:9256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.110210:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1788752970.110215:0:9256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752970.110222:0:9256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.110244:0:9256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.110256:0:9256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.110275:0:9256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.110296:0:9256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788752970.110883:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182683904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 812us (1050us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788752970.110892:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788752970.110920:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788752970.110928:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182684032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788752970.111073:0:9256:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788752970.111077:0:9256:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788752970 00002000:00010000:3.0:1788752970.111080:0:9256:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788752970.111082:0:9256:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788752970 -> 1788752970 00002000:00010000:3.0:1788752970.111084:0:9256:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788752970.111114:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182684032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (1180us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788752970.111147:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788752970.111181:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788752970.111224:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9b88b2f480/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788752970.111231:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182684032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788752970.111242:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788752970.111247:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788752970.111270:0:3305:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9b88b2f800 x1875643182683904/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788752986 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788752970.111279:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9b88b2f800/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788752970.111292:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9b88b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182683904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788752970.113948:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+18:11511:x1875643164865920:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 63245us (63530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752970.113960:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 182 00010000:00010000:0.0:1788752970.114957:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752970.114977:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.114992:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752970.114997:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.115010:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.115035:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.115044:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050cdb066/0x80c8383f484909ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.115077:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752970.115079:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752970.115081:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752970.118060:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.122890:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164866048 00000100:00100000:3.0:1788752970.122913:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164866048 00000100:00100000:3.0:1788752970.123336:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:3.0:1788752970.123349:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+10:2359:x1875643164866048:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788752970.190646:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1788752970.191395:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1788752970.191539:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2359:x1875643164866048:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 68188us (73482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752970.191561:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:0.0:1788752970.198925:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.200457:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164866304 00000100:00100000:3.0:1788752970.200475:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164866304 00000100:00100000:3.0:1788752970.201278:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 183 00000100:00100000:3.0:1788752970.201294:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+18:11511:x1875643164866304:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752970.201356:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752970.201389:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f484909d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f9 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.201408:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:3.0:1788752970.201414:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752970.201450:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.201466:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.201476:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788752970.202568:0:7899:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000edfd5717 reply state 000000002d9dc379 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.202587:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788752970.203815:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+19:11511:x1875643164866304:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 2516us (4891us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788752970.203828:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 183 00000100:00100000:2.0:1788752970.208144:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752970.211492:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164866432 00000100:00100000:0.0:1788752970.211511:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164866432 00000100:00100000:0.0:1788752970.211601:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:0.0:1788752970.211612:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164866432:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788752970.211874:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788752970.211878:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788752970 -> 1788752969 00002000:00010000:0.0:1788752970.211892:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788752968 00002000:00010000:0.0:1788752970.211895:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788752970 -> 1788752969 00002000:00010000:0.0:1788752970.211897:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788752970.211968:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164866432:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 357us (3860us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788752970.211976:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00010000:00010000:3.0:1788752970.212425:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.212436:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.212443:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.212449:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752970.212453:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.212461:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.212478:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:3.0:1788752970.212481:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752970.212486:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.212491:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f484909f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752970.219378:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.219455:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164866688 00000100:00100000:3.0:1788752970.219466:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164866688 00000100:00100000:3.0:1788752970.219548:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 184 00000100:00100000:3.0:1788752970.219571:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+18:11511:x1875643164866688:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788752970.219763:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.219780:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.219790:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.219823:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.219838:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 18 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.220049:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182684160:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752970.220171:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:1.0:1788752970.231346:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752970.231380:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164866816 00000100:00100000:1.0:1788752970.231388:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164866816 00010000:00010000:1.0:1788752970.231429:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752970.231473:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:1.0:1788752970.231482:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+19:2361:x1875643164866816:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752970.231497:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752970.231504:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.231515:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.231535:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:1.0:1788752970.231540:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.231549:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.231632:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.231651:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752970.231758:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+19:2361:x1875643164866816:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 276us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752970.231765:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00010000:00010000:3.0:1788752970.232000:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484909bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1eb expref: 18 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.232016:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182684160:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752970.232036:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232044:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232061:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232093:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232099:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232105:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232110:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752970.232114:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232152:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232162:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:3.0:1788752970.232164:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788752970.232168:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.232173:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f484909fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.232228:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+17:11511:x1875643164866688:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 12660us (12860us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788752970.232236:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 184 00000040:00080000:2.0:1788752970.234212:0:12497:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788752970.234220:0:12497:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788752970.234272:0:12497:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788752970.234278:0:12497:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788752970.239758:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.240428:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164866944 00000100:00100000:3.0:1788752970.240439:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164866944 00000100:00100000:3.0:1788752970.240493:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:3.0:1788752970.240504:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+8:2358:x1875643164866944:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788752970.240561:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.240589:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 8 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.240599:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752970.240603:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752970.240608:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.240642:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 8 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.240656:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 8 pid: 12054 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.240779:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875643182684288:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752970.240865:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:3.0:1788752970.247316:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1875643182684288:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752970.247350:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752970.248624:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.248796:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164867072 00000100:00100000:3.0:1788752970.248805:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164867072 00010000:00010000:3.0:1788752970.248841:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 9 pid: 12054 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.248914:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:3.0:1788752970.248923:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164867072:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752970.248939:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752970.248963:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 9 pid: 12054 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.248977:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 9 pid: 12054 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.249000:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054d10e6f/0x80c8383f484909e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f207 expref: 9 pid: 12054 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.249014:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752970.249019:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752970.249025:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.249035:0:11152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.249088:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752970.249173:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164867072:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 250us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752970.249181:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00010000:00010000:0.0:1788752970.250065:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250078:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250108:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250117:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250150:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250158:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752970.250162:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250171:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250203:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.250211:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ac12952/0x80c8383f48490a01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752970.250275:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf184a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:2358:x1875643164866944:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 9771us (10524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752970.250283:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:0.0:1788752970.266966:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.267045:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164867328 00000100:00100000:3.0:1788752970.267056:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164867328 00000100:00100000:3.0:1788752970.267114:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 185 00000100:00100000:3.0:1788752970.267186:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+17:11511:x1875643164867328:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788752970.267275:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.267293:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.267305:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.267522:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.267534:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.267543:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.267601:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.267633:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 18 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.267648:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182684416:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752970.267809:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:3.0:1788752970.276512:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdda4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182684416:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752970.276547:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752970.279958:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752970.280337:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164867456 00000100:00100000:2.0:1788752970.280347:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164867456 00010000:00010000:2.0:1788752970.280388:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752970.280449:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 72 00000100:00100000:2.0:1788752970.280460:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+19:2360:x1875643164867456:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752970.280477:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752970.280484:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.280497:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.280521:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484909c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1f2 expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.280537:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:2.0:1788752970.280543:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.280565:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.280579:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.280606:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752970.280827:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+18:2360:x1875643164867456:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 367us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752970.280835:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 72 00010000:00010000:0.0:1788752970.280952:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.280960:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788752970.282080:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788752970.282514:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788752970.282586:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788752970.282690:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875643182684544:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788752970.282752:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752970.282783:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788752970.283458:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182684544 00000100:00100000:2.0:1788752970.283481:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182684544 00000100:00100000:2.0:1788752970.283543:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788752970.283574:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875643182684544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788752970.283683:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875643182684544:12345-0@lo:1000:mdt00_000.0 Request processed in 132us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752970.283690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788752970.285375:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1788752970.285388:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9b88b2f480, transno 4294967315 00000100:00100000:0.0:1788752970.285412:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875643182684544:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788752970.285964:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788752970.286044:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf0b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875643182684672:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788752970.286104:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752970.286170:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788752970.286760:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182684672 00000100:00100000:2.0:1788752970.286769:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182684672 00000100:00100000:2.0:1788752970.286818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788752970.286827:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875643182684672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788752970.287013:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875643182684672:12345-0@lo:1000:mdt00_000.0 Request processed in 187us (907us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788752970.287021:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788752970.287866:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf0b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875643182684672:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788752970.287908:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.287919:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.287926:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.287932:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752970.287937:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.287944:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.287959:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:0.0:1788752970.287962:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788752970.287967:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.287973:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288006:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288019:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288026:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288031:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752970.288034:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288040:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288047:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:0.0:1788752970.288049:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788752970.288052:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288057:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490944 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288091:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288098:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288175:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.288310:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 21 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752970.288324:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a878eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182684800:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752970.288403:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788752970.300910:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a878eb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182684800:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752970.300948:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752970.302236:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752970.302311:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164867584 00000100:00100000:3.0:1788752970.302320:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164867584 00010000:00010000:3.0:1788752970.302361:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 22 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752970.303184:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:3.0:1788752970.303204:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+22:2360:x1875643164867584:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752970.303220:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752970.303229:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 22 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.303244:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 22 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.303266:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f1d6 expref: 22 pid: 5834 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.303295:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:3.0:1788752970.303301:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.303310:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.303318:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752970.303347:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752970.303407:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+21:2360:x1875643164867584:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 210us (1177us total) trans 0 rc 0/0 00010000:00010000:1.0:1788752970.303486:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303494:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303514:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303520:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303526:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303532:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4da00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752970.303537:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303544:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303563:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:1.0:1788752970.303566:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788752970.303570:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303576:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48490a16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303588:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303593:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303598:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303610:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752970.303613:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303619:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303627:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b91646400) 00010000:00010000:1.0:1788752970.303630:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788752970.303632:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752970.303638:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752970.303868:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+21:11511:x1875643164867328:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 36744us (36914us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788752970.303878:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 185 00000020:00080000:1.0:1788752970.303884:0:5832:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788752970.303996:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788752970.304002:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788752970.304530:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788752970.304537:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788752970.308263:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:0.0:1788752970.312415:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752970.312508:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164867840 00000100:00100000:2.0:1788752970.312518:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164867840 00000100:00100000:2.0:1788752970.312755:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:2.0:1788752970.312767:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f737850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+20:11511:x1875643164867840:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788752970.313453:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788752970.313593:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788752970.313642:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.313784:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.313798:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.313808:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.313823:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.313829:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752970.313858:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788752970.313984:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f737850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+22:11511:x1875643164867840:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1217us (1578us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788752970.313993:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000020:00080000:2.0:1788752970.313999:0:5837:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788752970.314095:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752970.314102:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.314109:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752970.314113:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.314140:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.314154:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c9b89426400) 00010000:00010000:0.0:1788752970.314157:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788752970.314161:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.314167:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490a1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752970.314190:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752970.314192:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752970.314194:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752970.669955:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752971.691236:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788752972.209225:0:12548:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788752972.209235:0:12548:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788752972.209888:0:12548:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788752972.209899:0:12548:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788752972.313233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752972.313408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164868096 00000100:00100000:1.0:1788752972.313420:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164868096 00000100:00100000:1.0:1788752972.313512:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 186 00000100:00100000:1.0:1788752972.313524:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+22:11530:x1875643164868096:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752972.313561:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752972.313598:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f20e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.313707:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490a2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.313723:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490a2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.313738:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490a2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752972.313751:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788752972.313890:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f20e expref: 25 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.313921:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f20e expref: 24 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.313929:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:1.0:1788752972.313933:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788752972.313936:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270800, rc 0) 00000100:00100000:1.0:1788752972.314006:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdda4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+24:11530:x1875643164868096:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 484us (783us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788752972.314013:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 186 00000100:00080000:3.0:1788752972.315153:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752972.329515:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.329659:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164868224 00000100:00100000:3.0:1788752972.329674:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164868224 00000100:00100000:3.0:1788752972.329976:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 187 00000100:00100000:3.0:1788752972.329994:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+24:11530:x1875643164868224:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:3.0:1788752972.330117:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330452:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330468:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330490:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330498:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330505:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330852:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330862:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330870:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788752972.330946:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330964:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330970:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.330991:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331000:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.331004:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331013:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331031:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752972.331035:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.331042:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331049:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331066:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331073:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331080:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331086:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.331089:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331107:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331118:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.331159:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.331165:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331314:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331347:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331353:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331359:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331364:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.331367:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331374:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331383:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6200) 00010000:00010000:3.0:1788752972.331386:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.331389:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.331407:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.331532:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+24:11530:x1875643164868224:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 1539us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752972.331554:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 187 00000100:00100000:2.0:1788752972.367146:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.368244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164868480 00000100:00100000:3.0:1788752972.368265:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164868480 00000100:00100000:3.0:1788752972.368366:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 188 00000100:00100000:3.0:1788752972.368381:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+24:11533:x1875643164868480:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752972.368416:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752972.368448:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f215 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.368570:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.368589:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.368603:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.368621:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.368629:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.368654:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369071:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369082:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369090:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752972.369105:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788752972.369301:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369311:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369320:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369327:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.369332:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369341:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369361:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752972.369365:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.369381:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369388:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369416:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369423:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369429:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369435:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.369439:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369445:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369452:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b94cc6200) 00010000:00010000:3.0:1788752972.369455:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.369457:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369463:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369529:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369572:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.369581:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.369583:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752972.369585:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80030600, rc 0) 00000100:00100000:3.0:1788752972.369696:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+26:11533:x1875643164868480:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1319us (2574us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788752972.369705:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 188 00000100:00100000:3.0:1788752972.378602:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752972.378696:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164868608 00000100:00100000:1.0:1788752972.378712:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164868608 00000100:00100000:1.0:1788752972.378801:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:1.0:1788752972.378812:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+26:11533:x1875643164868608:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:1.0:1788752972.378906:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.378926:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.378940:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.378971:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.378979:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.378986:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.378993:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752972.378997:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.379006:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.379211:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:1.0:1788752972.379216:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752972.379222:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.379229:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752972.379324:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+26:11533:x1875643164868608:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 512us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752972.379334:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 189 00000100:00100000:1.0:1788752972.382835:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.385463:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164868864 00000100:00100000:3.0:1788752972.385614:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164868864 00000100:00100000:3.0:1788752972.385930:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1788752972.385945:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+26:11533:x1875643164868864:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1788752972.388057:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+27:11533:x1875643164868864:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 2103us (5223us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788752972.388075:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1788752972.428993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752972.441717:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164869120 00000100:00100000:1.0:1788752972.441734:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164869120 00000100:00100000:1.0:1788752972.441792:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 190 00000100:00100000:1.0:1788752972.441802:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+27:11059:x1875643164869120:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752972.441830:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752972.441854:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f21c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.441956:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.441971:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.441979:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.442015:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.442044:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 28 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752972.442074:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbda1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182684928:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752972.442197:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752972.451782:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.451819:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164869248 00000100:00100000:3.0:1788752972.451830:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164869248 00010000:00010000:3.0:1788752972.451925:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 29 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.451965:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:3.0:1788752972.451986:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+29:2361:x1875643164869248:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752972.452003:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752972.452011:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 29 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456214:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 29 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456245:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.456252:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456262:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456271:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456302:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752972.456376:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+29:2361:x1875643164869248:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 4390us (4602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752972.456386:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00010000:00010000:3.0:1788752972.456465:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030600/0x80c8383f48490a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f215 expref: 28 pid: 5835 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.456484:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbda1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1875643182684928:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752972.456508:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456532:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456549:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752972.456572:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788752972.456763:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490a78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456781:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.456789:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.456792:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788752972.456794:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271200, rc 0) 00000100:00100000:3.0:1788752972.456820:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+28:11059:x1875643164869120:12345-192.168.203.5@tcp:101:bash.0 Request processed in 15020us (27840us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788752972.456828:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 190 00000100:00100000:3.0:1788752972.465457:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.465599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164869504 00000100:00100000:3.0:1788752972.465610:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164869504 00000100:00100000:3.0:1788752972.465669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 191 00000100:00100000:3.0:1788752972.465679:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+28:11059:x1875643164869504:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:3.0:1788752972.466010:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.466045:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.466069:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788752972.466156:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788752972.466186:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000847eb175 reply state 000000004b3ef0be transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.466197:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788752972.466254:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788752972.466368:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+32:11059:x1875643164869504:12345-192.168.203.5@tcp:36:bash.0 Request processed in 689us (922us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788752972.466376:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 191 00000020:00080000:3.0:1788752972.466380:0:5832:0:(tgt_main.c:545:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788752972.472523:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.472550:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.472558:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.472564:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.472569:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.472575:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.472595:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.472598:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.472609:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.472615:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490a8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.476061:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.476109:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164869632 00000100:00100000:3.0:1788752972.476118:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164869632 00000100:00100000:3.0:1788752972.476243:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 192 00000100:00100000:3.0:1788752972.476255:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+31:11059:x1875643164869632:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1788752972.476285:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752972.476312:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f223 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.476386:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f223 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.476401:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f223 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.476423:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.476426:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752972.476430:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80031600, rc 0) 00000100:00100000:3.0:1788752972.476489:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+32:11059:x1875643164869632:12345-192.168.203.5@tcp:101:bash.0 Request processed in 237us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752972.476498:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 192 00000100:00100000:1.0:1788752972.486062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752972.486219:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164869760 00000100:00100000:2.0:1788752972.486231:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164869760 00000100:00080000:3.0:1788752972.486315:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752972.486388:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:3.0:1788752972.486443:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:11059:x1875643164869760:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:3.0:1788752972.486473:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752972.486505:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f22a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788752972.486554:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e3449, atime: 0x6a9e3448, ctime: 0x6a9e3449, blocks: 0xb 00010000:00010000:3.0:1788752972.486584:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1788752972.486590:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752972.486601:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.486627:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.486645:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80030600, rc 0) 00000100:00100000:3.0:1788752972.486741:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbda1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+8:11059:x1875643164869760:12345-192.168.203.5@tcp:101:bash.0 Request processed in 318us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752972.486748:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:0.0:1788752972.490861:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752972.490936:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164869888 00000100:00100000:2.0:1788752972.490953:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164869888 00002000:00010000:2.0:1788752972.491009:0:6695:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788752972.491015:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9a878ead80 with x1875643164869888 ext(0->18446744073709551615) 00002000:00010000:2.0:1788752972.491039:0:6695:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9a878ead80. 00000100:00100000:2.0:1788752972.491082:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788752972.491093:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2359:x1875643164869888:12345-192.168.203.5@tcp:10:bash.0 00002000:00010000:2.0:1788752972.492044:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788752972.492050:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788752969 -> 1788752972 00002000:00010000:2.0:1788752972.492053:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788752968 -> 1788752968 00002000:00010000:2.0:1788752972.492055:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788752969 -> 1788752972 00002000:00010000:2.0:1788752972.492057:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788752972.493011:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+9:2359:x1875643164869888:12345-192.168.203.5@tcp:10:bash.0 Request processed in 1912us (2158us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788752972.493035:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00002000:00010000:2.0:1788752972.493041:0:6695:0:(ofd_dev.c:2829:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788752972.493044:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9a878ead80 with x1875643164869888 ext(0->18446744073709551615) 00002000:00010000:2.0:1788752972.493053:0:6695:0:(ofd_dev.c:2834:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9a878ead80. 00000100:00100000:1.0:1788752972.595445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.595555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164870016 00000100:00100000:3.0:1788752972.595566:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164870016 00000100:00100000:3.0:1788752972.595675:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00100000:3.0:1788752972.595687:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+32:11547:x1875643164870016:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:3.0:1788752972.595768:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.595785:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.595810:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.595828:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.595835:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.595842:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596093:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596104:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596111:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788752972.596197:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596208:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596216:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596223:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596253:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.596257:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596264:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596276:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752972.596279:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.596284:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596291:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490aa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596306:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596312:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596318:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596323:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.596326:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596331:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596350:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b94cc6f00) 00010000:00010000:3.0:1788752972.596352:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.596355:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596361:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596382:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596388:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596393:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596398:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.596401:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596406:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596413:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.596415:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.596418:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.596423:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.596509:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+32:11547:x1875643164870016:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 823us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752972.596517:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 193 00000100:00100000:1.0:1788752972.635059:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.635545:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164870272 00000100:00100000:3.0:1788752972.635558:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164870272 00000100:00100000:2.0:1788752972.635865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:2.0:1788752972.635879:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+32:11550:x1875643164870272:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752972.635910:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752972.635937:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490ab7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f231 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636041:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636059:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636074:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636093:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636100:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636107:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636702:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490acc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636715:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636723:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752972.636735:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788752972.636869:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636877:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636885:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636892:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752972.636898:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636908:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636924:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752972.636927:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752972.636933:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636950:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490abe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636967:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636974:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636980:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636985:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752972.636988:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.636993:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.637000:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b89426e00) 00010000:00010000:2.0:1788752972.637003:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752972.637005:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.637012:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.637076:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490ab7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f231 expref: 35 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.637093:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f231 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.637108:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:2.0:1788752972.637110:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788752972.637113:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1000, rc 0) 00000100:00100000:2.0:1788752972.637608:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+34:11550:x1875643164870272:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1727us (2560us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788752972.637619:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 194 00000100:00100000:1.0:1788752972.640441:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.640568:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164870400 00000100:00100000:3.0:1788752972.640585:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164870400 00000100:00100000:3.0:1788752972.640665:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:3.0:1788752972.640679:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+34:11550:x1875643164870400:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1788752972.640778:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.640801:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.640813:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.640864:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.640881:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 34 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.640899:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a8704d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182685056:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752972.641034:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788752972.644213:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752972.644351:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164870656 00000100:00100000:0.0:1788752972.644363:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164870656 00000100:00100000:0.0:1788752972.644450:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:0.0:1788752972.644462:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+35:5595:x1875643164870656:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788752972.644916:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+36:5595:x1875643164870656:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 453us (714us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788752972.644925:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1788752972.645755:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a8704d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182685056:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752972.645817:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.647805:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752972.647930:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164870784 00000100:00100000:0.0:1788752972.647942:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164870784 00010000:00010000:0.0:1788752972.647998:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 36 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752972.648046:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:0.0:1788752972.648057:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+36:2360:x1875643164870784:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752972.648077:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752972.648085:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 36 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.648099:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 36 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.648356:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490a7f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f21c expref: 36 pid: 5834 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.648379:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:0.0:1788752972.648385:0:11152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.648397:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.648406:0:11152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.648481:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752972.648562:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+35:2360:x1875643164870784:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 506us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752972.648571:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00010000:00010000:3.0:1788752972.652353:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652375:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652427:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652435:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652443:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652449:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.652454:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652462:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652484:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:3.0:1788752972.652487:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788752972.652494:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.652501:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.652858:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+34:11550:x1875643164870400:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 12174us (12422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752972.652871:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 195 00000100:00100000:2.0:1788752972.656402:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752972.656555:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164871040 00000100:00100000:0.0:1788752972.656569:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164871040 00000100:00100000:0.0:1788752972.656687:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:0.0:1788752972.656700:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+34:11550:x1875643164871040:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752972.657035:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+35:11550:x1875643164871040:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 336us (647us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788752972.657044:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00010000:00010000:0.0:1788752972.714630:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752972.742009:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.743862:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164871296 00000100:00100000:3.0:1788752972.743883:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164871296 00000100:00100000:3.0:1788752972.743981:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 196 00000100:00100000:3.0:1788752972.743993:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+35:11561:x1875643164871296:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:3.0:1788752972.744026:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752972.744052:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490ae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f238 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.744489:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.744508:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.744523:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.744552:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.744560:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.744567:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745154:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490af6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745167:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745466:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490af6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752972.745483:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788752972.745619:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745628:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745636:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745641:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752972.745646:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745945:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745961:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752972.745964:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752972.745970:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745976:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.745994:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746000:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746067:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746073:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752972.746077:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746083:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746092:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b94cc6f00) 00010000:00010000:2.0:1788752972.746095:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752972.746098:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746115:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746293:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490ae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f238 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746309:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490af6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f238 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.746317:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:2.0:1788752972.746319:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752972.746322:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1400, rc 0) 00000100:00100000:2.0:1788752972.746479:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+37:11561:x1875643164871296:12345-192.168.203.5@tcp:101:cat.0 Request processed in 2486us (4481us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788752972.746489:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 196 00000100:00100000:3.0:1788752972.755783:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752972.755867:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164871552 00000100:00100000:1.0:1788752972.755884:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164871552 00000100:00100000:1.0:1788752972.755979:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:1.0:1788752972.755993:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+37:11561:x1875643164871552:12345-192.168.203.5@tcp:35:cat.0 00000100:00100000:1.0:1788752972.756436:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+38:11561:x1875643164871552:12345-192.168.203.5@tcp:35:cat.0 Request processed in 435us (658us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788752972.756445:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 54 00000100:00100000:0.0:1788752972.783824:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752972.783937:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164871808 00000100:00100000:2.0:1788752972.783951:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164871808 00000100:00100000:2.0:1788752972.784027:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 197 00000100:00100000:2.0:1788752972.784038:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+38:11562:x1875643164871808:12345-192.168.203.5@tcp:36:rm.0 00010000:00010000:2.0:1788752972.784154:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788752972.784193:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490af6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f238 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784226:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490acc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f231 expref: 37 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784269:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490a94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f223 expref: 36 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784288:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b94cc6100) 00010000:00010000:2.0:1788752972.784304:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752972.784331:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784347:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784358:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784373:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784379:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784386:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784733:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784743:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.784750:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788752972.785425:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788752972.785438:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372519314633ns, next at 373519312212ns, rc = 0 00010000:00010000:2.0:1788752972.785505:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785516:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785526:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785547:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785555:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785561:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785594:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788752972.785619:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785625:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785632:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785637:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752972.785639:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752972.785647:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.785648:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.785654:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788752972.785658:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.785658:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.788082:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.788164:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:1.0:1788752972.788385:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788752972.788394:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.788401:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1800/0x80c8383f48490b19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.788851:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752972.788855:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752972.788859:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752972.789513:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:2.0:1788752972.789521:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788752972.789531:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789551:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490b12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789645:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789654:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789661:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789669:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752972.789674:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789682:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789697:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752972.789700:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752972.789724:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.789731:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490b04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788752972.789744:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000012c9301 reply state 000000000f8ee6ea transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752972.789755:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752972.789903:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+37:11562:x1875643164871808:12345-192.168.203.5@tcp:36:rm.0 Request processed in 5860us (6092us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788752972.789914:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 197 00010000:00010000:3.0:1788752972.794665:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.794689:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.794699:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.794706:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.794712:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.794720:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.794743:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b89426e00) 00010000:00010000:3.0:1788752972.794747:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.794753:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.794760:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f48490b0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752972.835422:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752972.835599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164872064 00000100:00100000:1.0:1788752972.835613:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164872064 00000100:00100000:1.0:1788752972.835696:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 198 00000100:00100000:1.0:1788752972.835708:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+36:11568:x1875643164872064:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752972.835741:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752972.835770:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490b20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f23f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.835933:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.835953:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.835970:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.835989:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.835998:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752972.836014:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788752972.836923:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788752972.839902:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.839939:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.839959:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840040:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840050:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840059:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840068:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788752972.840072:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840082:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840099:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:0.0:1788752972.840103:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788752972.840109:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840117:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788752972.840215:0:5832:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000a74c3de0 reply state 0000000008fa32a5 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752972.840227:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788752972.840294:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490b20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840315:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.840325:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:0.0:1788752972.840328:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752972.840331:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4dc00, rc 0) 00000100:00100000:0.0:1788752972.840513:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+39:11568:x1875643164872064:12345-192.168.203.5@tcp:101:bash.0 Request processed in 4805us (5104us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788752972.840527:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 198 00010000:00010000:3.0:1788752972.852434:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.852453:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.852479:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.852485:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752972.852490:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.852498:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.852515:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9ba3667000) 00010000:00010000:3.0:1788752972.852518:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752972.852524:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.852529:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490b2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752972.858059:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752972.858457:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164872192 00000100:00100000:2.0:1788752972.858470:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164872192 00000100:00100000:2.0:1788752972.858558:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1788752972.858570:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+5:2359:x1875643164872192:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1788752972.858591:0:12054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752972.858618:0:12054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f246 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788752972.858651:0:12054:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788752972.858671:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1788752972.858677:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752972.858685:0:12054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 6 pid: 12054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.858706:0:12054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 6 pid: 12054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752972.858742:0:12054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0a00, rc 0) 00000100:00100000:2.0:1788752972.858808:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+6:2359:x1875643164872192:12345-192.168.203.5@tcp:101:bash.0 Request processed in 241us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752972.858815:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00080000:0.0:1788752972.861064:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752972.865602:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752972.865996:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164872320 00000100:00100000:0.0:1788752972.866008:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164872320 00000100:00100000:0.0:1788752972.866108:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:0.0:1788752972.866119:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+6:11568:x1875643164872320:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:0.0:1788752972.866177:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752972.866201:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f24d expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.866242:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 7 pid: 12054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.866268:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752972.866274:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752972.866280:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.866331:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 7 pid: 12054 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.866347:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 7 pid: 12054 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752972.866363:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a878e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875643182685184:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752972.866456:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788752972.869041:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a878e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1875643182685184:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752972.869084:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752972.869107:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4d200, rc 0) 00000100:00100000:0.0:1788752972.869203:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf187100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:11568:x1875643164872320:12345-192.168.203.5@tcp:101:bash.0 Request processed in 3086us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752972.869212:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:2.0:1788752972.874069:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.874169:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164872448 00000100:00100000:3.0:1788752972.874181:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164872448 00010000:00010000:3.0:1788752972.874227:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 7 pid: 12054 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.874275:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:3.0:1788752972.874285:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164872448:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752972.874301:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752972.874338:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 7 pid: 12054 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.874373:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 7 pid: 12054 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.874396:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8675d43/0x80c8383f48490b43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f246 expref: 7 pid: 12054 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.874414:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752972.874418:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752972.874426:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.874436:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752972.874479:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752972.874493:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a8704ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875643182685312:192.168.203.5@tcp:105: 00000100:00100000:3.0:1788752972.874589:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788752972.882504:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752972.882697:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a8704ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875643182685312:192.168.203.5@tcp:105: 00010000:00010000:3.0:1788752972.882724:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752972.882781:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+6:2360:x1875643164872448:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 8496us (8720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752972.882792:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:1.0:1788752972.883009:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164872704 00000100:00100000:1.0:1788752972.883017:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164872704 00000100:00100000:1.0:1788752972.883061:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:1.0:1788752972.883070:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+38:11568:x1875643164872704:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:1.0:1788752972.883408:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+39:11568:x1875643164872704:12345-192.168.203.5@tcp:35:bash.0 Request processed in 338us (914us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788752972.883415:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 55 00000100:00100000:1.0:1788752973.017065:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.017223:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164872832 00000100:00100000:3.0:1788752973.017243:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164872832 00000100:00100000:3.0:1788752973.017329:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:3.0:1788752973.017342:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+39:11584:x1875643164872832:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752973.017376:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752973.017406:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f254 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.017716:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.017735:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.017749:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752973.017798:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788752973.017802:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788752973.017826:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.017858:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f254 expref: 41 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.017880:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f254 expref: 40 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.017891:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752973.017894:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788752973.017920:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:3.0:1788752973.018051:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+40:11584:x1875643164872832:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 710us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752973.018060:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 199 00000100:00100000:2.0:1788752973.029242:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752973.029568:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164873088 00000100:00100000:1.0:1788752973.029590:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164873088 00000100:00100000:1.0:1788752973.029699:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:1.0:1788752973.029712:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+40:11584:x1875643164873088:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752973.029743:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752973.029773:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490b5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f25b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.029910:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.029939:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.029954:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752973.029990:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788752973.030175:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490b5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f25b expref: 43 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.030198:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f25b expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.030208:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:1.0:1788752973.030211:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752973.030215:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270600, rc 0) 00000100:00100000:1.0:1788752973.030299:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+42:11584:x1875643164873088:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 589us (1072us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788752973.030307:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 200 00000100:00100000:2.0:1788752973.034339:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752973.034400:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.034498:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164873472 00000100:00100000:3.0:1788752973.034513:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164873472 00000100:00100000:3.0:1788752973.034627:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:3.0:1788752973.034641:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba7490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+42:2358:x1875643164873472:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752973.034667:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752973.034707:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270600/0x80c8383f48490b66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f25b expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.034741:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:3.0:1788752973.034748:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752973.034833:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba7490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+41:2358:x1875643164873472:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 195us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752973.034846:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:1.0:1788752973.035394:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164873344 00000100:00100000:1.0:1788752973.035404:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164873344 00000100:00100000:1.0:1788752973.035451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 201 00000100:00100000:1.0:1788752973.035460:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+41:11584:x1875643164873344:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788752973.035693:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752973.035719:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490b74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f262 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.035863:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490b7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.035882:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490b7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.036688:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490b7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752973.036713:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788752973.039006:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490b74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f262 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.039076:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490b7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f262 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.039088:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:1.0:1788752973.039091:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788752973.039096:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270c00, rc 0) 00000100:00100000:1.0:1788752973.040370:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b87338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+43:11584:x1875643164873344:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 4896us (6033us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788752973.040386:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 201 00000100:00100000:2.0:1788752973.049236:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.049432:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164873600 00000100:00100000:3.0:1788752973.049447:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164873600 00000100:00100000:3.0:1788752973.049516:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:3.0:1788752973.049528:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+6:2361:x1875643164873600:12345-192.168.203.5@tcp:1:lfs.0 00010000:00010000:3.0:1788752973.049606:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.049634:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.049672:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752973.049677:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752973.049683:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.049730:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 6 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.049747:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 6 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752973.049765:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a8704e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182685440:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788752973.049991:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788752973.061085:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a8704e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1875643182685440:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752973.061196:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.061801:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752973.063293:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164873728 00000100:00100000:0.0:1788752973.063313:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164873728 00002000:00100000:0.0:1788752973.063397:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c9baf18b800 x1875643164873728/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:189/0 lens 504/0 e 0 to 0 dl 1788752984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752973.063431:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9baf18b800 with x1875643164873728 ext(0->8) 00010000:00010000:0.0:1788752973.063443:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 7 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.063464:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 7 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788752973.063474:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c9baf18b800 00000100:00100000:0.0:1788752973.063526:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:0.0:1788752973.063547:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf18b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164873728:12345-192.168.203.5@tcp:4:lfs.0 00000100:00100000:0.0:1788752973.066663:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf18b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164873728:12345-192.168.203.5@tcp:4:lfs.0 Request processed in 3106us (4843us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788752973.066683:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00002000:00100000:0.0:1788752973.066700:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c9baf18b800 x1875643164873728/t4294967308(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:189/0 lens 504/448 e 0 to 0 dl 1788752984 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752973.066712:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9baf18b800 with x1875643164873728 ext(0->8) 00010000:00010000:0.0:1788752973.066726:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 9 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.066751:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 9 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788752973.066760:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c9baf18b800 00000100:00100000:3.0:1788752973.073042:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752973.073363:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164873856 00000100:00100000:2.0:1788752973.073377:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164873856 00010000:00010000:2.0:1788752973.073440:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 9 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.073496:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:2.0:1788752973.073508:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+9:2358:x1875643164873856:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752973.073529:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788752973.073565:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788752973.073569:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788752973 00002000:00010000:2.0:1788752973.073571:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788752973 00002000:00010000:2.0:1788752973.073574:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788752973 00010000:00010000:2.0:1788752973.073581:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 9 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.073616:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 9 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.073646:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005476f041/0x80c8383f48490b4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f24d expref: 9 pid: 6691 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.073669:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752973.073674:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752973.073681:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.073692:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.073737:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752973.073823:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2358:x1875643164873856:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 317us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752973.073831:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00010000:00010000:1.0:1788752973.074032:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074044:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074094:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074103:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074113:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074487:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752973.074494:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074506:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074526:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.074545:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f48490b89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752973.074634:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164873600:12345-192.168.203.5@tcp:1:lfs.0 Request processed in 25105us (25412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752973.074647:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:1.0:1788752973.081024:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.081331:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164874112 00000100:00100000:3.0:1788752973.081345:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164874112 00000100:00100000:3.0:1788752973.081521:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 56 00000100:00100000:3.0:1788752973.081545:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f735c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+43:11584:x1875643164874112:12345-192.168.203.5@tcp:35:lfs.0 00000004:00010000:3.0:1788752973.081645:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490b7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f262 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788752973.082106:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788752973.092009:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788752973.092954:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788752973.093052:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.093088:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.093097:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.093673:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.093702:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 47 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.093723:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf18ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875643182685568:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752973.093876:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788752973.102266:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf18ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1875643182685568:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752973.102325:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752973.102883:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.106885:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164874240 00000100:00100000:3.0:1788752973.106910:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164874240 00010000:00010000:3.0:1788752973.106989:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 48 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752973.107197:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:3.0:1788752973.107212:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+48:2360:x1875643164874240:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752973.107235:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752973.107244:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 48 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.107260:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 48 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.107290:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4dc00/0x80c8383f48490b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f23f expref: 48 pid: 5832 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.107311:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:3.0:1788752973.107318:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.107329:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.107338:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.107383:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752973.107466:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+47:2360:x1875643164874240:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 257us (4589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752973.107475:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00010000:00010000:2.0:1788752973.108036:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.108049:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788752973.108305:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788752973.108634:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788752973.108805:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf18ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875643182685696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788752973.108902:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752973.108972:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788752973.110962:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182685696 00000100:00100000:1.0:1788752973.110983:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182685696 00000100:00100000:1.0:1788752973.111110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788752973.111152:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875643182685696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788752973.111351:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875643182685696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 228us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752973.111360:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788752973.112302:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752973.112384:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf18ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875643182685696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788752973.113050:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788752973.114654:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baf18ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875643182685824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788752973.114791:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752973.114851:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788752973.115144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182685824 00000100:00100000:1.0:1788752973.115157:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182685824 00000100:00100000:1.0:1788752973.115794:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788752973.115808:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5836:x1875643182685824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788752973.116186:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875643182685824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 379us (1394us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788752973.116195:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788752973.116325:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baf18ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1875643182685824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788752973.116448:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788752973.116511:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.116525:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.116543:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.116550:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752973.116556:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.116566:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.116587:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:2.0:1788752973.116591:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788752973.116599:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.116605:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490b90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788752973.116875:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788752973.117032:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788752973.117049:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372850925536ns, next at 373850922181ns, rc = 0 00000001:00080000:2.0:1788752973.117080:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788752973.117144:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b91646300) 00010000:00010000:2.0:1788752973.117148:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788752973.117157:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490b7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f262 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.117309:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f735c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+50:11584:x1875643164874112:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 35777us (36309us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788752973.117320:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 56 00000020:00080000:2.0:1788752973.117325:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788752973.124045:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.124183:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164874368 00000100:00100000:3.0:1788752973.124220:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164874368 00000100:00100000:3.0:1788752973.124308:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 202 00000100:00100000:3.0:1788752973.124322:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+50:11584:x1875643164874368:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752973.124359:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752973.124411:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490b97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f269 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.124493:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490b97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f269 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.124511:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490b97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f269 expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.124545:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752973.124548:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752973.124553:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8e00, rc 0) 00000100:00100000:3.0:1788752973.124645:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+51:11584:x1875643164874368:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 326us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752973.124653:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 202 00000100:00100000:3.0:1788752973.128652:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752973.128829:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164874624 00000100:00100000:0.0:1788752973.128844:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164874624 00000100:00100000:0.0:1788752973.128929:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:0.0:1788752973.128943:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+51:11584:x1875643164874624:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752973.129341:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+52:11584:x1875643164874624:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 401us (705us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788752973.129351:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 57 00000100:00100000:2.0:1788752973.218491:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.218617:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164874752 00000100:00100000:3.0:1788752973.218632:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164874752 00000100:00100000:3.0:1788752973.218723:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:3.0:1788752973.218736:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+52:11594:x1875643164874752:12345-192.168.203.5@tcp:34:lfs.0 00010000:00010000:3.0:1788752973.218855:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.218880:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.218923:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.218946:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.218954:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.218961:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219093:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219102:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219108:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788752973.219235:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219250:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219258:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219266:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219284:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.219288:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219296:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219312:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752973.219315:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.219320:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219327:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219342:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219348:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219353:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219358:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.219361:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219366:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219384:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b94cc6500) 00010000:00010000:3.0:1788752973.219386:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.219390:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219395:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490ba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219422:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219428:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219434:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219439:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.219443:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219449:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219455:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752973.219458:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.219461:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.219466:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.219756:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+52:11594:x1875643164874752:12345-192.168.203.5@tcp:34:lfs.0 Request processed in 1018us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752973.219768:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 203 00000100:00100000:1.0:1788752973.279334:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.279498:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164875008 00000100:00100000:3.0:1788752973.279512:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164875008 00000100:00100000:3.0:1788752973.279610:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:3.0:1788752973.279624:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+52:11597:x1875643164875008:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752973.279657:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752973.279687:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f270 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.279795:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.279818:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.279838:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.279857:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.279865:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.279872:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280047:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490bc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280057:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280084:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752973.280099:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788752973.280490:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280501:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280509:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280516:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.280521:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280529:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280556:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752973.280559:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.280566:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280625:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490bba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280653:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280659:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280674:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280679:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.280683:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280690:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280698:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b94cc6500) 00010000:00010000:3.0:1788752973.280701:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.280704:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280710:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280772:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f270 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280789:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f270 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.280799:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752973.280801:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752973.280805:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9c00, rc 0) 00000100:00100000:3.0:1788752973.281039:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+54:11597:x1875643164875008:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1416us (1719us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788752973.281061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 204 00000100:00100000:3.0:1788752973.289993:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752973.290669:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164875136 00000100:00100000:1.0:1788752973.290689:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164875136 00000100:00100000:1.0:1788752973.290827:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:1.0:1788752973.290840:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+54:11597:x1875643164875136:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:1.0:1788752973.290949:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.290972:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.290986:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.291043:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.291052:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.291060:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.291067:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752973.291072:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.291081:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.291096:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:1.0:1788752973.291100:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752973.291105:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.291111:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752973.291317:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+54:11597:x1875643164875136:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 479us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752973.291326:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 205 00000100:00100000:2.0:1788752973.293547:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752973.293858:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164875392 00000100:00100000:0.0:1788752973.293943:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164875392 00000100:00100000:0.0:1788752973.294072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:0.0:1788752973.294086:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+54:11597:x1875643164875392:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:0.0:1788752973.294705:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+55:11597:x1875643164875392:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 619us (1180us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788752973.294714:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 58 00000100:00100000:0.0:1788752973.405913:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752973.406035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164875648 00000100:00100000:1.0:1788752973.406049:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164875648 00000100:00100000:1.0:1788752973.406152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:1.0:1788752973.406195:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+55:11607:x1875643164875648:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752973.406237:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752973.406241:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788752973.406276:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48490b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f254 expref: 55 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.406303:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:1.0:1788752973.406308:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788752973.406324:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bdd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f277 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.406468:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.406486:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.406510:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752973.406527:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788752973.406926:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bdd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f277 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.406949:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f277 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.406958:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:1.0:1788752973.406961:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752973.406975:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270c00, rc 0) 00000100:00100000:1.0:1788752973.407072:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+56:11607:x1875643164875648:12345-192.168.203.5@tcp:101:bash.0 Request processed in 880us (1176us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788752973.407082:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 206 00000100:00100000:3.0:1788752973.413074:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752973.413324:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164875904 00000100:00100000:2.0:1788752973.413338:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164875904 00000100:00100000:2.0:1788752973.413419:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 207 00000100:00100000:2.0:1788752973.413432:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+56:11607:x1875643164875904:12345-192.168.203.5@tcp:36:bash.0 00010000:00010000:2.0:1788752973.413526:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788752973.413576:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490be4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f277 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.413608:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f48490bc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f270 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.413621:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:2.0:1788752973.413647:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752973.413951:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.413969:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.413983:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788752973.414043:0:7899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788752973.414071:0:7899:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000078e3955a reply state 00000000c1e6a04b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.414081:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752973.414283:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+57:11607:x1875643164875904:12345-192.168.203.5@tcp:36:bash.0 Request processed in 850us (1222us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788752973.414292:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 207 00000020:00080000:2.0:1788752973.414299:0:7899:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788752973.417561:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.417591:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.417592:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00010000:00010000:3.0:1788752973.417606:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.417614:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.417623:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.417634:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752973.417710:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164876032 00000100:00100000:1.0:1788752973.417725:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164876032 00000100:00100000:1.0:1788752973.417824:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 208 00000100:00100000:1.0:1788752973.417837:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+57:11607:x1875643164876032:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788752973.417871:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752973.417898:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f27e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.418028:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.424895:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.424931:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752973.425014:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788752973.425020:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752973.425049:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.425139:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490bf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.425170:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.425205:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:1.0:1788752973.425209:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788752973.425213:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271800, rc 0) 00000100:00100000:1.0:1788752973.425322:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+58:11607:x1875643164876032:12345-192.168.203.5@tcp:101:bash.0 Request processed in 7486us (7735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752973.425333:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 208 00010000:00010000:3.0:1788752973.425820:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752973.425826:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.425836:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.425845:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490bf2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752973.428955:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752973.429077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164876288 00000100:00100000:2.0:1788752973.429091:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164876288 00000100:00100000:2.0:1788752973.429213:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:2.0:1788752973.429227:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+57:11607:x1875643164876288:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:2.0:1788752973.429922:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+58:11607:x1875643164876288:12345-192.168.203.5@tcp:35:bash.0 Request processed in 693us (979us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788752973.429933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 59 00000100:00100000:3.0:1788752973.509704:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752973.510169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164876416 00000100:00100000:2.0:1788752973.510183:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164876416 00000100:00100000:2.0:1788752973.510274:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:2.0:1788752973.510308:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+58:11613:x1875643164876416:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752973.510342:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752973.510371:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f285 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.511060:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48490c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.511082:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48490c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.511097:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48490c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752973.511232:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788752973.511238:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752973.511259:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48490c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.511292:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f285 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.511314:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48490c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f285 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.511325:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752973.511328:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752973.511333:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1600, rc 0) 00000100:00100000:2.0:1788752973.511591:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+59:11613:x1875643164876416:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1284us (1901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752973.511616:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 209 00000100:00100000:0.0:1788752973.515617:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.517118:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164876544 00000100:00100000:3.0:1788752973.517245:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164876544 00000100:00100000:3.0:1788752973.517396:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:3.0:1788752973.517427:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+59:11613:x1875643164876544:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752973.517457:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752973.517487:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490c15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f28c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517592:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517612:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517638:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517666:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517674:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517681:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517807:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517818:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517825:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752973.517887:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788752973.517893:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788752973.517917:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517932:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517944:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517950:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517958:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517966:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.517971:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517979:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.517994:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752973.517997:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.518004:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518011:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48490c1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518045:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518051:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518057:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518062:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752973.518065:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518071:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518078:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b94cc6500) 00010000:00010000:3.0:1788752973.518080:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752973.518083:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518088:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031600/0x80c8383f48490c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518168:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031a00/0x80c8383f48490c15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f28c expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518242:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f28c expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.518260:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752973.518263:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752973.518266:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173a00, rc 0) 00000100:00100000:3.0:1788752973.518355:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+60:11613:x1875643164876544:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 931us (2753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752973.518364:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 210 00000100:00100000:0.0:1788752973.528077:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752973.528277:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.528380:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164876928 00000100:00100000:3.0:1788752973.528394:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164876928 00000100:00100000:3.0:1788752973.528487:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:3.0:1788752973.528512:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+60:2358:x1875643164876928:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752973.528543:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752973.528577:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f28c expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752973.528605:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752973.528612:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752973.528790:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+59:2358:x1875643164876928:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 290us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752973.528799:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1788752973.528957:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164876800 00000100:00100000:2.0:1788752973.528963:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164876800 00000100:00100000:2.0:1788752973.529017:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:2.0:1788752973.529026:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+59:11613:x1875643164876800:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752973.529051:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752973.529074:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f293 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.529273:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.529291:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.529301:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.529348:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.529365:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 60 pid: 5834 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752973.529385:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182685952:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752973.529515:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788752973.532095:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752973.532226:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164877056 00000100:00100000:1.0:1788752973.532238:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164877056 00010000:00010000:1.0:1788752973.532291:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 61 pid: 5834 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752973.532343:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1788752973.532356:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+61:2360:x1875643164877056:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752973.532373:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752973.532380:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 61 pid: 5834 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.532395:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 61 pid: 5834 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.532422:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:1.0:1788752973.532428:0:11152:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.532439:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.532483:0:11152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.532511:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752973.532587:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+61:2360:x1875643164877056:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 233us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752973.532595:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00010000:00010000:3.0:1788752973.533592:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271800/0x80c8383f48490c00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f27e expref: 60 pid: 5834 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752973.533797:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182685952:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788752973.533831:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.534154:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.534180:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752973.534216:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788752973.534457:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 61 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.534548:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 60 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.534558:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:2.0:1788752973.534561:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788752973.534564:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0400, rc 0) 00000100:00100000:2.0:1788752973.534825:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+60:11613:x1875643164876800:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 5798us (6762us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788752973.534835:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 211 00000100:00100000:0.0:1788752973.539845:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.539987:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164877312 00000100:00100000:3.0:1788752973.540002:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164877312 00000100:00100000:3.0:1788752973.540089:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:3.0:1788752973.540104:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+60:11613:x1875643164877312:12345-192.168.203.5@tcp:103:lfs.0 00010000:00010000:2.0:1788752973.540590:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752973.540706:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f48490b97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f269 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752973.540731:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:2.0:1788752973.540736:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752973.540817:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+59:11613:x1875643164877312:12345-192.168.203.5@tcp:103:lfs.0 Request processed in 716us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752973.540827:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1788752973.546743:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752973.546924:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164877440 00000100:00100000:1.0:1788752973.546939:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164877440 00000100:00100000:1.0:1788752973.547020:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 212 00000100:00100000:1.0:1788752973.547034:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+59:11613:x1875643164877440:12345-192.168.203.5@tcp:58:lfs.0 00010000:00010000:1.0:1788752973.547234:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.547258:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752973.547273:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788752973.547740:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788752973.547870:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+59:11613:x1875643164877440:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 836us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752973.547881:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 212 00000100:00100000:1.0:1788752973.556098:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752973.559090:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164877568 00000100:00100000:3.0:1788752973.559112:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164877568 00000100:00100000:0.0:1788752973.559828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 213 00000100:00100000:0.0:1788752973.559844:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+59:11613:x1875643164877568:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788752973.559875:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752973.559934:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f29a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.560019:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.560032:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.560061:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.560078:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.560095:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:0.0:1788752973.560098:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788752973.560103:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752973.560112:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c200, rc 0) 00000100:00100000:0.0:1788752973.560435:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+60:11613:x1875643164877568:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 593us (4352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752973.560443:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 213 00010000:00010000:2.0:1788752973.742629:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752973.998940:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bae9d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182686080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788752973.999053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752973.999225:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182686080 00000100:00100000:0.0:1788752973.999238:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182686080 00000100:00100000:0.0:1788752973.999349:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788752973.999374:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182686080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788752973.999441:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788752973.999571:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788752974.000136:0:6882:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373733997317ns, next at 374733993729ns, rc = 0 00000100:00100000:0.0:1788752974.003174:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182686080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3786us (4103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752974.003197:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788752974.003602:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bae9d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182686080:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788752974.378565:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752974.378580:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752974.378854:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788752974.378865:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788752974.379505:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a878ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182686208:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788752974.379697:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788752974.386388:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a878ea680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182686208:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788752974.386926:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.387068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164877696 00000100:00100000:2.0:1788752974.387080:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164877696 00000100:00100000:2.0:1788752974.387195:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00100000:2.0:1788752974.387209:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+60:11614:x1875643164877696:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788752974.387266:0:5834:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788752974.387406:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+60:11614:x1875643164877696:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 198us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.387415:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 214 00000100:00080000:3.0:1788752974.388619:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788752974.394826:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.395013:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164877824 00000100:00100000:2.0:1788752974.395027:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164877824 00000100:00100000:2.0:1788752974.395109:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:2.0:1788752974.395165:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+60:11614:x1875643164877824:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788752974.395272:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395293:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395310:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395329:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395336:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395343:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395409:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395420:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395427:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752974.395479:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788752974.395485:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752974.395883:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395899:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395907:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395916:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395923:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752974.395928:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395937:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395952:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:2.0:1788752974.395966:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752974.395975:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.395981:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490c54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396000:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396006:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396012:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396018:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752974.396021:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396026:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396035:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9c9b89426400) 00010000:00010000:2.0:1788752974.396038:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752974.396041:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396046:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c5b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396064:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396077:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396083:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396088:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752974.396091:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396096:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396104:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:2.0:1788752974.396107:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752974.396110:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.396115:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.396635:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+60:11614:x1875643164877824:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 1510us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.396648:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 215 00000100:00100000:0.0:1788752974.401518:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.401643:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164878080 00000100:00100000:1.0:1788752974.401655:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164878080 00000100:00100000:1.0:1788752974.401787:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:1.0:1788752974.401800:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+60:11614:x1875643164878080:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752974.401833:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752974.401862:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490c69 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2a1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402011:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402032:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402047:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752974.402062:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788752974.402444:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402455:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402464:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402473:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752974.402495:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402505:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402521:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:1.0:1788752974.402536:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788752974.402543:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402551:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490c70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402609:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490c69 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2a1 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402622:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:1.0:1788752974.402625:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788752974.402628:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490c69 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2a1 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.402640:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271200, rc 0) 00000100:00100000:1.0:1788752974.402775:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+61:11614:x1875643164878080:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 976us (1274us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788752974.402784:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 216 00000100:00100000:3.0:1788752974.406431:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752974.406776:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164878208 00000100:00100000:0.0:1788752974.406790:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164878208 00000100:00100000:0.0:1788752974.406866:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 217 00000100:00100000:0.0:1788752974.406879:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+61:11614:x1875643164878208:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788752974.406931:0:5835:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788752974.407060:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+61:11614:x1875643164878208:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 182us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752974.407069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 217 00000100:00100000:0.0:1788752974.415837:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.415962:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164878464 00000100:00100000:2.0:1788752974.415979:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164878464 00000100:00100000:2.0:1788752974.416070:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:2.0:1788752974.416083:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+61:11614:x1875643164878464:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788752974.416437:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752974.416443:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788752974.416490:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48490c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f285 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.416515:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752974.416521:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752974.416551:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2a8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788752974.417103:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1788752974.417604:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490c85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.417623:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.417636:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490c85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.417730:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490c7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2a8 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.417752:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490c85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2a8 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.417762:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9b94cc6500) 00010000:00010000:3.0:1788752974.417765:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752974.417769:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173000, rc 0) 00000100:00100000:3.0:1788752974.417844:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+62:11614:x1875643164878464:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1763us (2023us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788752974.417854:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 218 00000100:00100000:0.0:1788752974.424199:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.424306:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164878720 00000100:00100000:2.0:1788752974.424335:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164878720 00000100:00100000:2.0:1788752974.424414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00100000:2.0:1788752974.424426:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a878eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+62:11614:x1875643164878720:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788752974.424510:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752974.424565:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490c85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2a8 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424606:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9b94cc6500) 00010000:00010000:2.0:1788752974.424626:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752974.424660:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424678:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424690:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424706:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424713:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424719:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424805:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424813:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424831:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424838:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752974.424844:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424854:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424863:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752974.424866:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752974.424870:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424878:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490c93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424889:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424895:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424902:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424907:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752974.424910:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424926:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424935:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4a0a16fd (ffff9c9b89426400) 00010000:00010000:2.0:1788752974.424938:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752974.424941:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.424947:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0c00/0x80c8383f48490c9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4a0a16fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.425066:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a878eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+61:11614:x1875643164878720:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 641us (886us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788752974.425075:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 219 00000100:00100000:0.0:1788752974.431870:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.432051:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164878848 00000100:00100000:1.0:1788752974.432493:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164878848 00000100:00100000:1.0:1788752974.432634:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:1.0:1788752974.432648:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+61:11614:x1875643164878848:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752974.432693:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752974.432731:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490ca1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2af expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.432786:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.432804:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.432819:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.432954:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.432978:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.432987:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:1.0:1788752974.432990:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788752974.432995:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271600, rc 0) 00000100:00100000:1.0:1788752974.433105:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+62:11614:x1875643164878848:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 459us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752974.433148:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 220 00000100:00100000:0.0:1788752974.440024:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.440097:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164879104 00000100:00100000:2.0:1788752974.440111:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164879104 00000100:00100000:2.0:1788752974.440204:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 221 00000100:00100000:2.0:1788752974.440215:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+62:11614:x1875643164879104:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788752974.440330:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.440351:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.440366:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788752974.441006:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788752974.441115:0:7899:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000038c271c9 reply state 0000000033ac72df transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.441225:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752974.441388:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+64:11614:x1875643164879104:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1172us (1375us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788752974.441397:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 221 00000100:00100000:0.0:1788752974.446006:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.446668:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164879232 00000100:00100000:1.0:1788752974.446682:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164879232 00000100:00100000:1.0:1788752974.446771:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 222 00000100:00100000:1.0:1788752974.446784:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+64:11614:x1875643164879232:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752974.446841:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752974.446873:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2b6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.446971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 65 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.446991:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 65 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.447018:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:1.0:1788752974.447022:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788752974.447027:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270400, rc 0) 00000100:00100000:1.0:1788752974.447265:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+65:11614:x1875643164879232:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 333us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752974.447274:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 222 00010000:00010000:3.0:1788752974.450630:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.450652:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.450662:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.450670:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752974.450676:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.450685:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.450706:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752974.450725:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788752974.450732:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.450739:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48490caf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752974.451606:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.451698:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164879360 00000100:00100000:1.0:1788752974.451712:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164879360 00000100:00100000:1.0:1788752974.451804:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:1.0:1788752974.451816:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+9:2360:x1875643164879360:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788752974.452542:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+10:2360:x1875643164879360:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 724us (944us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788752974.452551:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00080000:3.0:1788752974.452645:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752974.457490:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.457633:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164879616 00000100:00100000:2.0:1788752974.457648:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164879616 00000100:00100000:2.0:1788752974.457743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1788752974.457756:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+64:11614:x1875643164879616:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788752974.458555:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+65:11614:x1875643164879616:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 337us (618us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788752974.458571:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 60 00000100:00100000:2.0:1788752974.465635:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.465734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164879872 00000100:00100000:3.0:1788752974.465749:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164879872 00000100:00100000:3.0:1788752974.465860:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 223 00000100:00100000:3.0:1788752974.465873:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+65:11614:x1875643164879872:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788752974.466034:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bae9d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+65:11614:x1875643164879872:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 163us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752974.466042:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 223 00000100:00100000:2.0:1788752974.469081:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.469299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164880000 00000100:00100000:1.0:1788752974.469312:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164880000 00000100:00100000:1.0:1788752974.469389:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:1.0:1788752974.469402:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+65:11614:x1875643164880000:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752974.469454:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752974.469485:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490cbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2bd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.469610:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.469630:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.469645:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788752974.469697:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788752974.469722:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.469756:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271200/0x80c8383f48490cbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2bd expref: 67 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.469782:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2bd expref: 66 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.469792:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:1.0:1788752974.469796:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788752974.469800:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270c00, rc 0) 00000100:00100000:1.0:1788752974.469946:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+66:11614:x1875643164880000:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 545us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752974.469955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 224 00000100:00100000:0.0:1788752974.473644:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.473815:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164880128 00000100:00100000:3.0:1788752974.473829:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164880128 00000100:00100000:3.0:1788752974.473909:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:3.0:1788752974.473921:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+10:2361:x1875643164880128:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788752974.473949:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752974.473978:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2c4 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788752974.474016:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e344e, blocks: 0x1 00010000:00010000:3.0:1788752974.474047:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1788752974.474052:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788752974.474064:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.474107:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 11 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.474425:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173a00, rc 0) 00000100:00100000:2.0:1788752974.475204:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+11:2361:x1875643164880128:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1277us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.475216:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:2.0:1788752974.478095:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752974.478500:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164880384 00000100:00100000:0.0:1788752974.478515:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164880384 00000100:00100000:1.0:1788752974.478695:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:1.0:1788752974.478709:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+66:11614:x1875643164880384:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788752974.478890:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf186d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+66:11614:x1875643164880384:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 183us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752974.478899:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 225 00000100:00100000:2.0:1788752974.481725:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.481824:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164880512 00000100:00100000:1.0:1788752974.481837:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164880512 00000100:00100000:1.0:1788752974.481905:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:1.0:1788752974.481916:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+11:11614:x1875643164880512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788752974.481942:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788752974.481966:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2cb expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.482011:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.482022:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752974.482028:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788752974.482034:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.482079:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 12 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.482096:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 12 pid: 6691 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752974.482174:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875643182686336:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788752974.482379:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752974.485516:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.485626:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164880640 00000100:00100000:2.0:1788752974.485638:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164880640 00010000:00010000:2.0:1788752974.485691:0:11152:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 13 pid: 6691 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.485742:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:2.0:1788752974.485753:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+13:2361:x1875643164880640:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788752974.485792:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752974.485822:0:11152:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 13 pid: 6691 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.485838:0:11152:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 13 pid: 6691 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.485869:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752974.485874:0:11152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752974.485884:0:11152:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 13 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.485896:0:11152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 13 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.485958:0:11152:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 13 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.485974:0:11152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11152:1875643182686464:192.168.203.5@tcp:105: 00000100:00100000:2.0:1788752974.486073:0:11152:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b98d1fe40 going to sleep for 11 seconds 00010000:00010000:1.0:1788752974.486830:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058fbb0fe/0x80c8383f48490ccb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2c4 expref: 13 pid: 6691 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752974.486857:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef1c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1875643182686336:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788752974.486889:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.486904:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271200, rc 0) 00000100:00100000:1.0:1788752974.486963:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf185500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+12:11614:x1875643164880512:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 5047us (5253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752974.486972:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:0.0:1788752974.492024:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.492175:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164880768 00000100:00100000:3.0:1788752974.492190:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164880768 00002000:00100000:3.0:1788752974.492271:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9c9bbde5e680 x1875643164880768/t0(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:190/0 lens 504/0 e 0 to 0 dl 1788752985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788752974.492286:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbde5e680 with x1875643164880768 ext(0->12) 00002000:00010000:3.0:1788752974.492294:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbde5e680 00000100:00100000:3.0:1788752974.492324:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1788752974.492334:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+12:2360:x1875643164880768:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788752974.493318:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:240b527c-392e-42d3-b78c-b594aea00353+14:2360:x1875643164880768:12345-192.168.203.5@tcp:4:lhsmtool_posix.0 Request processed in 977us (1303us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1788752974.493332:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00002000:00100000:0.0:1788752974.493343:0:6695:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9c9bbde5e680 x1875643164880768/t4294967320(0) o4->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:190/0 lens 504/448 e 0 to 0 dl 1788752985 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752974.493355:0:6695:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9bbde5e680 with x1875643164880768 ext(0->12) 00002000:00010000:0.0:1788752974.493360:0:6695:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9bbde5e680 00000100:00100000:2.0:1788752974.493552:0:11152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11152:1875643182686464:192.168.203.5@tcp:105: 00010000:00010000:2.0:1788752974.493594:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752974.493621:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+13:2361:x1875643164880640:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 7870us (8116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.493631:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:2.0:1788752974.496676:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.496795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164880896 00000100:00100000:1.0:1788752974.496808:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164880896 00000100:00100000:1.0:1788752974.496883:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00100000:1.0:1788752974.496895:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+66:11614:x1875643164880896:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788752974.541509:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967497 is committed 00000020:00080000:0.0:1788752974.541542:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9b98d1fc00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788752974.541550:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5bada00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9b98d1ff00 00000020:00080000:0.0:1788752974.541554:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bb5bad900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9a85de6c00 00000001:00080000:0.0:1788752974.541577:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:0.0:1788752974.541602:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788752974.541610:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:0.0:1788752974.541628:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788752974.541640:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9b98d1f0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788752974.541643:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9ba011bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9b98d1f3c0 00000020:00080000:0.0:1788752974.541646:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9ba011b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9bbde06c00 00000004:00080000:0.0:1788752974.541658:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788752974.541749:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1788752974.541926:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182686592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788752974.541987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752974.542070:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182686720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788752974.542095:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752974.542174:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182686592 00000100:00100000:0.0:1788752974.542181:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182686592 00000100:00100000:0.0:1788752974.542224:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182686720 00000100:00100000:0.0:1788752974.542227:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182686720 00000100:00100000:0.0:1788752974.542247:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788752974.542255:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182686592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788752974.542288:0:12054:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788752974.542313:0:12054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542335:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542345:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788752974.542349:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788752974.542353:0:12054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542382:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542397:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 12 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752974.542408:0:12054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12054:1875643182686848:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788752974.542476:0:12054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9812f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788752974.542493:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788752974.542501:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875643182686720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788752974.542515:0:6691:0:(ofd_dev.c:1864:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1788752974.542552:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9e344d, atime: 0x6a9e344d, ctime: 0x6a9e344d, blocks: 0x1 00010000:00010000:0.0:1788752974.542558:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542566:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1788752974.542569:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788752974.542574:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542588:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542596:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542604:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.542620:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788752974.543186:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1875643182686720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 683us (1087us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788752974.543195:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1788752974.543235:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752974.543242:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.543251:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4d400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788752974.543255:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.543265:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.543282:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.543290:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dde67b18/0x80c8383f48490ce0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.543311:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752974.543313:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752974.543314:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788752974.543353:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9bbde5f100/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788752974.543360:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182686720:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788752974.543772:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788752974.543954:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788752974.544266:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+20:11614:x1875643164880896:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 47369us (47604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752974.544276:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 226 00000100:00100000:0.0:1788752974.545721:0:12054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12054:1875643182686848:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788752974.545913:0:12054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752974.546581:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.546684:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164881024 00000100:00100000:3.0:1788752974.546693:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164881024 00010000:00010000:3.0:1788752974.546815:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 13 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.546899:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:3.0:1788752974.546911:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+13:2361:x1875643164881024:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752974.546928:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752974.546941:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 13 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.546953:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 13 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.546977:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008096812d/0x80c8383f48490a9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f22a expref: 13 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.547001:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752974.547016:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752974.547022:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.547032:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.547066:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752974.547284:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+12:2361:x1875643164881024:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 374us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752974.547292:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00010000:00010000:0.0:1788752974.547998:0:12054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.548011:0:12054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.548023:0:12054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.548031:0:12054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.548047:0:12054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788752974.548689:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3304:x1875643182686592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6430us (6697us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788752974.548699:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1788752974.548880:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9bbde5d880/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788752974.548893:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182686592:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788752974.548987:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752974.548995:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.549020:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788752974.549024:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.549034:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.549052:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.549060:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442166fa/0x80c8383f48490cd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.549083:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752974.549086:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752974.549087:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752974.549642:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.549728:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164881152 00000100:00100000:1.0:1788752974.549813:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164881152 00000100:00100000:1.0:1788752974.549893:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:1.0:1788752974.549904:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+12:2361:x1875643164881152:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788752974.584575:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1788752974.584594:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788752974.584810:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164881152:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 34902us (35165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.584822:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:1.0:1788752974.588402:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.588667:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164881408 00000100:00100000:3.0:1788752974.588758:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164881408 00000100:00100000:3.0:1788752974.588837:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 227 00000100:00100000:3.0:1788752974.588850:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+20:11614:x1875643164881408:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788752974.589294:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752974.589334:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2bd expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.589456:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752974.589462:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788752974.589507:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.589534:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.589548:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788752974.590274:0:5835:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000006227e88a reply state 000000009e308a72 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.590296:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788752974.590443:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+21:11614:x1875643164881408:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 1590us (2054us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788752974.590455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 227 00010000:00010000:3.0:1788752974.592996:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.593021:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.593030:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.593037:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752974.593043:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.593053:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.593074:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752974.593078:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752974.593084:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.593120:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490ce7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752974.604599:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752974.607787:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164881536 00000100:00100000:0.0:1788752974.607803:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164881536 00000100:00100000:0.0:1788752974.607903:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1788752974.607915:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164881536:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788752974.608253:0:9256:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788752974.608257:0:9256:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788752973 00002000:00010000:0.0:1788752974.608260:0:9256:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788752973 00002000:00010000:0.0:1788752974.608278:0:9256:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788752974 -> 1788752973 00002000:00010000:0.0:1788752974.608281:0:9256:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788752974.608347:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:240b527c-392e-42d3-b78c-b594aea00353+8:2360:x1875643164881536:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 433us (3759us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788752974.608356:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:0.0:1788752974.613035:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.615759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164881792 00000100:00100000:2.0:1788752974.615776:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164881792 00000100:00100000:2.0:1788752974.615978:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:2.0:1788752974.615990:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+20:11614:x1875643164881792:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788752974.616078:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.616097:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.616107:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.616180:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.616195:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 20 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.616227:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182686976:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752974.616336:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:2.0:1788752974.622572:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875643182686976:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752974.622609:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752974.625645:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.625772:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164881920 00000100:00100000:3.0:1788752974.625783:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164881920 00010000:00010000:3.0:1788752974.625834:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 21 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.625890:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:3.0:1788752974.625902:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+21:2360:x1875643164881920:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752974.625919:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752974.625928:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 21 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.625944:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 21 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.625970:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271600/0x80c8383f48490ca8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2af expref: 21 pid: 5832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.625991:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752974.625998:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.626008:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.626016:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.626083:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752974.626193:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+20:2360:x1875643164881920:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 293us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752974.626201:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00010000:00010000:1.0:1788752974.626776:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626786:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626827:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626834:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626841:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626847:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788752974.626852:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626859:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626883:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:1.0:1788752974.626886:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788752974.626890:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.626896:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0e00/0x80c8383f48490cee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752974.627005:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+19:11614:x1875643164881792:12345-192.168.203.5@tcp:55:lhsmtool_posix.0 Request processed in 11016us (13979us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788752974.627014:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 228 00000100:00100000:1.0:1788752974.636228:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.636316:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164882048 00000100:00100000:2.0:1788752974.636326:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164882048 00000100:00100000:2.0:1788752974.636388:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:2.0:1788752974.636399:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+8:2360:x1875643164882048:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788752974.636443:0:12054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.636464:0:12054:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.636473:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752974.636477:0:12054:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788752974.636482:0:12054:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.636515:0:12054:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.636539:0:12054:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 8 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.636569:0:12054:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12054:1875643182687104:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752974.636650:0:12054:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:1.0:1788752974.642566:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.642652:0:12054:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12054:1875643182687104:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752974.642686:0:12054:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.642707:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164882176 00000100:00100000:3.0:1788752974.642723:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164882176 00010000:00010000:3.0:1788752974.642780:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 9 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.642837:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:3.0:1788752974.642858:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+9:2361:x1875643164882176:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752974.642881:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752974.642917:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 9 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.642934:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 9 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.642968:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8d0701/0x80c8383f48490cd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2cb expref: 9 pid: 6688 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.642990:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752974.642996:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788752974.643003:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.643042:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.643083:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788752974.643156:0:12054:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643169:0:12054:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643205:0:12054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643213:0:12054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643222:0:12054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643228:0:12054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788752974.643233:0:12054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643264:0:12054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643284:0:12054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.643292:0:12054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056e3cc23/0x80c8383f48490cf5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.643419:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164882176:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 565us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752974.643448:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:2.0:1788752974.643474:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:240b527c-392e-42d3-b78c-b594aea00353+8:2360:x1875643164882048:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 7073us (7254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.643486:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 70 00000100:00100000:1.0:1788752974.646357:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.647966:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164882432 00000100:00100000:2.0:1788752974.647983:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164882432 00000100:00100000:2.0:1788752974.648050:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 229 00000100:00100000:2.0:1788752974.648060:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+19:11614:x1875643164882432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788752974.648165:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.648186:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.648208:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.648915:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.648941:0:7899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.648950:0:7899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.648987:0:7899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.649002:0:7899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 20 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.649016:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182687232:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752974.649108:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:2.0:1788752974.653218:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182687232:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752974.653249:0:7899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788752974.656298:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.656747:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164882560 00000100:00100000:3.0:1788752974.656941:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164882560 00010000:00010000:3.0:1788752974.656991:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 21 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.657035:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:3.0:1788752974.657047:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+21:2361:x1875643164882560:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752974.657680:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752974.657689:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 21 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.657703:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 21 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.657724:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270400/0x80c8383f48490cb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2b6 expref: 21 pid: 5834 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.657743:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752974.658045:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.658289:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.658297:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.658401:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752974.658530:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:240b527c-392e-42d3-b78c-b594aea00353+20:2361:x1875643164882560:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1473us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.658539:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00010000:00010000:3.0:1788752974.658624:0:7899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.658632:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788752974.658832:0:7899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788752974.659005:0:7899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788752974.659069:0:7899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788752974.659237:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a8704f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7899:1875643182687360:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788752974.659299:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752974.659329:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788752974.659673:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182687360 00000100:00100000:2.0:1788752974.659682:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182687360 00000100:00100000:2.0:1788752974.659731:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788752974.659741:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7899:x1875643182687360:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788752974.659841:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7899:x1875643182687360:12345-0@lo:1000:mdt00_003.0 Request processed in 101us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.659849:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788752974.660040:0:7899:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1788752974.660046:0:7899:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1788752974.660068:0:7899:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9bbde5d880, transno 4294967321 00000100:00100000:3.0:1788752974.660159:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a8704f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7899:1875643182687360:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788752974.660635:0:7899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788752974.660714:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a8704f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7899:1875643182687488:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788752974.660765:0:7899:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752974.660782:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788752974.663828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182687488 00000100:00100000:2.0:1788752974.663842:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182687488 00000100:00100000:2.0:1788752974.663930:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788752974.663941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7899:x1875643182687488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788752974.664280:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7899:x1875643182687488:12345-0@lo:1000:mdt00_003.0 Request processed in 340us (3520us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788752974.664288:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788752974.664588:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a8704f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7899:1875643182687488:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788752974.664644:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664654:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664673:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664679:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752974.664683:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664691:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664707:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667b00) 00010000:00010000:3.0:1788752974.664710:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752974.664714:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664721:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0200/0x80c8383f48490d03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664748:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664753:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664758:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664775:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752974.664779:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664784:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664792:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752974.664795:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752974.664802:0:7899:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664814:0:7899:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664823:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.664857:0:7899:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.664882:0:7899:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a8704fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182687616:192.168.203.5@tcp:105: 00000100:00100000:3.0:1788752974.664957:0:7899:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788752974.672262:0:7899:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a8704fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7899:1875643182687616:192.168.203.5@tcp:105: 00010000:00010000:3.0:1788752974.672298:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672328:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe271e00/0x80c8383f48490c46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672362:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672376:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672388:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672398:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672405:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672411:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672416:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752974.672420:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672427:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672437:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752974.672440:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752974.672443:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672455:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672466:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672472:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672477:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672482:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752974.672485:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672489:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672497:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752974.672499:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788752974.672502:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.672507:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0600/0x80c8383f48490cfc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752974.672748:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+23:11614:x1875643164882432:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 24687us (26409us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788752974.672758:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 229 00000020:00080000:3.0:1788752974.672771:0:7899:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788752974.673378:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752974.673384:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752974.673867:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788752974.673875:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788752974.675541:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752974.675680:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164882688 00000100:00100000:0.0:1788752974.675690:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164882688 00000100:00100000:0.0:1788752974.675761:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:0.0:1788752974.675772:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+23:11613:x1875643164882688:12345-192.168.203.5@tcp:49:lfs.0 00000100:00100000:0.0:1788752974.675914:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+23:11613:x1875643164882688:12345-192.168.203.5@tcp:49:lfs.0 Request processed in 142us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752974.675922:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 61 00000100:00100000:1.0:1788752974.678928:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752974.683296:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164882944 00000100:00100000:3.0:1788752974.683313:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164882944 00000100:00100000:0.0:1788752974.683745:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.683829:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164883200 00000100:00100000:1.0:1788752974.683834:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164883200 00000100:00100000:1.0:1788752974.683896:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 62 00000100:00100000:1.0:1788752974.683907:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f734050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+24:11614:x1875643164883200:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788752974.684612:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788752974.684714:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788752974.684757:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.684775:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.684787:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.684796:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.684803:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.684809:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752974.684826:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788752974.684916:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f734050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+26:11614:x1875643164883200:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1010us (1175us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788752974.684924:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 62 00000020:00080000:1.0:1788752974.684935:0:5836:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788752974.685144:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788752974.685151:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.685158:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788752974.685162:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.685170:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.685182:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c9ba3667900) 00010000:00010000:3.0:1788752974.685185:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788752974.685189:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.685194:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270c00/0x80c8383f48490d11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752974.685210:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752974.685213:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752974.685214:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752974.686483:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:2.0:1788752974.686494:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+25:11613:x1875643164882944:12345-192.168.203.5@tcp:58:lfs.0 00000040:00080000:2.0:1788752974.687002:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788752974.687482:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+25:11613:x1875643164882944:12345-192.168.203.5@tcp:58:lfs.0 Request processed in 986us (8560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.687491:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 230 00000100:00100000:0.0:1788752974.718606:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752974.718816:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164883328 00000100:00100000:2.0:1788752974.718828:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164883328 00000100:00100000:2.0:1788752974.718903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 231 00000100:00100000:2.0:1788752974.718913:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+25:11616:x1875643164883328:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788752974.718940:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752974.718961:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2d2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719031:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719076:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719089:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719106:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719114:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719166:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719427:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719442:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 26 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719450:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719485:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 26 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.719500:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 26 pid: 7899 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752974.719536:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182687744:192.168.203.5@tcp:104: 00000100:00100000:2.0:1788752974.719641:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:2.0:1788752974.727502:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1875643182687744:192.168.203.5@tcp:104: 00010000:00010000:2.0:1788752974.727541:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752974.727743:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752974.727941:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164883584 00000100:00100000:1.0:1788752974.727949:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164883584 00000100:00100000:1.0:1788752974.728009:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:1.0:1788752974.728020:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+27:5595:x1875643164883584:12345-192.168.203.5@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788752974.728322:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+28:5595:x1875643164883584:12345-192.168.203.5@tcp:35:ldlm_bl.0 Request processed in 302us (579us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788752974.728330:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 63 00000100:00100000:1.0:1788752974.733280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752974.733378:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164883712 00000100:00100000:0.0:1788752974.733389:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164883712 00010000:00010000:0.0:1788752974.733435:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 28 pid: 7899 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788752974.733477:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:0.0:1788752974.733487:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+28:2360:x1875643164883712:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752974.733515:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752974.733539:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 28 pid: 7899 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.733554:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 28 pid: 7899 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.733583:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0400/0x80c8383f48490c38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f293 expref: 28 pid: 7899 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.733604:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:0.0:1788752974.733610:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.733621:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.733630:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752974.733665:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752974.733733:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:240b527c-392e-42d3-b78c-b594aea00353+27:2360:x1875643164883712:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 247us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752974.733741:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00010000:00010000:2.0:1788752974.734558:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734570:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752974.734621:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788752974.734625:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752974.734646:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734662:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734672:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734679:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734687:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734693:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752974.734782:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734792:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734804:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:2.0:1788752974.734807:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752974.734812:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734818:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734832:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734838:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734844:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734849:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788752974.734852:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734858:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.734864:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c9b89426800) 00010000:00010000:2.0:1788752974.734867:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788752974.735087:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.735093:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1000/0x80c8383f48490d26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.735180:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1400/0x80c8383f48490d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2d2 expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.735196:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2d2 expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752974.735202:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:2.0:1788752974.735205:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788752974.735207:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1200, rc 0) 00000100:00100000:2.0:1788752974.735262:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:240b527c-392e-42d3-b78c-b594aea00353+26:11616:x1875643164883328:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 16349us (16664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752974.735270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 231 00010000:00010000:0.0:1788752974.768556:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752975.019191:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182687872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752975.019270:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752975.024642:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182688000:0@lo:400:kworker.0 00000100:00100000:1.0:1788752975.024906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752975.024945:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182687872 00000100:00100000:0.0:1788752975.024959:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182687872 00000100:00100000:1.0:1788752975.025022:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788752975.025032:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182688128:0@lo:400:kworker.0 00000100:00100000:0.0:1788752975.025050:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788752975.025064:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1875643182687872:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752975.025088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788752975.025319:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752975.025389:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788752975.025403:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182688256:0@lo:400:kworker.0 00000100:00100000:0.0:1788752975.025414:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3306:x1875643182687872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 348us (6138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752975.025425:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788752975.025468:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788752975.025469:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788752975.025557:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182687872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752975.025575:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182688128 00000100:00100000:0.0:1788752975.025583:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182688128 00000100:00100000:1.0:1788752975.025589:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182688384:0@lo:400:kworker.0 00000100:00100000:0.0:1788752975.025627:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182688256 00000100:00100000:1.0:1788752975.025632:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752975.025633:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182688256 00000100:00100000:0.0:1788752975.025670:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182688384 00000100:00100000:0.0:1788752975.025674:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182688384 00000100:00100000:0.0:1788752975.025694:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788752975.025701:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182688128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788752975.025708:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752975.025757:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182688128:12345-0@lo:400:kworker.0 Request processed in 56us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752975.025766:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788752975.025845:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788752975.025864:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182688256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752975.025917:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182688000 00000100:00100000:3.0:1788752975.025924:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182688000 00000100:00100000:2.0:1788752975.025949:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182688256:12345-0@lo:400:kworker.0 Request processed in 86us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752975.025965:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788752975.025979:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182688000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752975.026026:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0199c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182688000:12345-0@lo:400:kworker.0 Request processed in 53us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752975.026044:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788752975.026221:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182688256:0@lo:400:kworker.0 00000100:00100000:1.0:1788752975.026260:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182688128:0@lo:400:kworker.0 00000100:00100000:1.0:1788752975.026281:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182688000:0@lo:400:kworker.0 00000100:00100000:0.0:1788752975.026718:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788752975.026733:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182688384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752975.026745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788752975.026798:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182688384:12345-0@lo:400:kworker.0 Request processed in 70us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752975.026806:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788752975.026968:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182688384:0@lo:400:kworker.0 00000001:00080000:1.0:1788752975.085901:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788752975.085922:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:3.0:1788752975.157582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752975.157635:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752975.157725:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164883968 00000100:00100000:0.0:1788752975.157738:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164883968 00000100:00100000:0.0:1788752975.157833:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:0.0:1788752975.157845:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164883968:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752975.157975:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164883968:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 132us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752975.157984:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00080000:3.0:1788752975.158295:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788752975.158397:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164883840 00000100:00100000:2.0:1788752975.158403:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164883840 00000100:00100000:2.0:1788752975.158447:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 289 00000100:00100000:2.0:1788752975.158456:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164883840:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752975.158506:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba0198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164883840:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 52us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752975.158532:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 289 00000100:00100000:1.0:1788752975.163883:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752975.164001:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164884096 00000100:00100000:0.0:1788752975.164017:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164884096 00000100:00100000:0.0:1788752975.164156:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00100000:0.0:1788752975.164171:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164884096:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752975.164287:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164884096:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 119us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752975.164296:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 141 00000100:00080000:1.0:1788752975.164670:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788752975.600378:0:12601:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788752975.600391:0:12601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788752975.600444:0:12601:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788752975.600452:0:12601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788752975.723823:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788752975.723836:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788752975.723883:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788752975.723889:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788752975.724052:0:11669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182688512:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788752975.725527:0:11669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788752975.735665:0:11669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875643182688512:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788752975.738400:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752975.738672:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164884224 00000100:00100000:1.0:1788752975.738683:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164884224 00000100:00100000:1.0:1788752975.738746:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 232 00000100:00100000:1.0:1788752975.738756:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+26:11628:x1875643164884224:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788752975.738797:0:5832:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788752975.741344:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+26:11628:x1875643164884224:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 2578us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752975.741362:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 232 00000100:00100000:1.0:1788752975.747758:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752975.747859:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164884480 00000100:00100000:0.0:1788752975.747872:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164884480 00000100:00100000:0.0:1788752975.747950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:0.0:1788752975.747964:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+26:11628:x1875643164884480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788752975.747991:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788752975.748018:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4cc00/0x80c8383f48490d34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752975.748196:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f48490d3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752975.748248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f48490d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752975.748267:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f48490d3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788752975.748284:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788752975.748462:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4cc00/0x80c8383f48490d34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2d9 expref: 29 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752975.748484:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f48490d3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2d9 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752975.748494:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:0.0:1788752975.748498:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788752975.748502:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c800, rc 0) 00000100:00100000:0.0:1788752975.748590:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+28:11628:x1875643164884480:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 629us (842us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788752975.748599:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 233 00000100:00100000:2.0:1788752975.751844:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752975.751930:0:11152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164884608 00000100:00100000:3.0:1788752975.751941:0:11152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164884608 00000100:00100000:3.0:1788752975.752049:0:11152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:3.0:1788752975.752061:0:11152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+28:2358:x1875643164884608:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788752975.752076:0:11152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752975.752102:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f48490d3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2d9 expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.752153:0:11152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752975.752167:0:11152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752975.752236:0:11152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:240b527c-392e-42d3-b78c-b594aea00353+27:2358:x1875643164884608:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 177us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752975.752244:0:11152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:2.0:1788752975.760458:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752975.761615:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164884864 00000100:00100000:3.0:1788752975.761632:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164884864 00000100:00100000:3.0:1788752975.761782:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 234 00000100:00100000:3.0:1788752975.761795:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+27:11628:x1875643164884864:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788752975.762004:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762025:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762040:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762697:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762708:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762716:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762723:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752975.762728:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762736:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762752:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752975.762755:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788752975.762760:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752975.762765:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752975.763260:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+28:11628:x1875643164884864:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 1464us (2811us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788752975.763270:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 234 00000040:00080000:2.0:1788752975.769703:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788752975.769714:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788752975.773922:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788752975.773947:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788752975.780870:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752975.789744:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164885120 00000100:00100000:1.0:1788752975.789764:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164885120 00010000:00010000:1.0:1788752975.789852:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752975.790031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 64 00000100:00100000:0.0:1788752975.790579:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+28:11628:x1875643164885120:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788752975.790873:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+29:11628:x1875643164885120:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 301us (10010us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788752975.790882:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 64 00010000:00010000:3.0:1788752976.814225:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788752977.501877:0:12653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788752977.501886:0:12653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788752977.501932:0:12653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788752977.501938:0:12653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788752977.688347:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752977.688413:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164885376 00000100:00100000:3.0:1788752977.688424:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164885376 00000100:00100000:3.0:1788752977.688520:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00100000:3.0:1788752977.688532:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+29:11649:x1875643164885376:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:3.0:1788752977.688561:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788752977.688588:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2e0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.688697:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.688711:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.688724:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788752977.688736:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788752977.688884:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48490d50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2e0 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.688907:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2e0 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.688940:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752977.688943:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788752977.688947:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173000, rc 0) 00000100:00100000:3.0:1788752977.689019:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+31:11649:x1875643164885376:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 489us (687us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788752977.689027:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 235 00000100:00080000:3.0:1788752977.689054:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752977.697625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752977.697706:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164885504 00000100:00100000:3.0:1788752977.697720:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164885504 00000100:00100000:3.0:1788752977.697785:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 236 00000100:00100000:3.0:1788752977.697797:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+31:11649:x1875643164885504:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:3.0:1788752977.697879:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.697901:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.697916:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.697947:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.697955:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.697962:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.697988:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788752977.697992:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.698001:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.698014:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752977.698017:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788752977.698023:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752977.698030:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173a00/0x80c8383f48490d65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788752977.698299:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+31:11649:x1875643164885504:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 501us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752977.698308:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 236 00000100:00100000:3.0:1788752977.826716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752977.826846:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164885632 00000100:00100000:2.0:1788752977.826860:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164885632 00000100:00100000:2.0:1788752977.826961:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00100000:2.0:1788752977.826975:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb531d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2361:x1875643164885632:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:2.0:1788752977.827004:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752977.827036:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000674bf9c/0x80c8383f48490d6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2e7 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788752977.827081:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9e344d, atime: 0x6a9e344d, ctime: 0x6a9e344d, blocks: 0xb 00010000:00010000:2.0:1788752977.827114:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1788752977.827176:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788752977.827189:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000674bf9c/0x80c8383f48490d6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2e7 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752977.827226:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000674bf9c/0x80c8383f48490d6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2e7 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752977.827263:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1800, rc 0) 00000100:00100000:2.0:1788752977.827350:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb531d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+8:2361:x1875643164885632:12345-192.168.203.5@tcp:101:cat.0 Request processed in 377us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752977.827359:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 71 00000100:00080000:3.0:1788752977.827794:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788752977.835579:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752977.835829:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752977.835899:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164885760 00000100:00100000:0.0:1788752977.835920:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164885760 00002000:00100000:0.0:1788752977.836006:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9c9a8704fb80 x1875643164885760/t0(0) o3->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:193/0 lens 488/0 e 0 to 0 dl 1788752988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752977.836020:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9a8704fb80 with x1875643164885760 ext(0->4095) 00002000:00010000:0.0:1788752977.836030:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9a8704fb80 00000100:00100000:0.0:1788752977.836075:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:0.0:1788752977.836088:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2359:x1875643164885760:12345-192.168.203.5@tcp:3:cat.0 00000100:00100000:0.0:1788752977.836594:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:240b527c-392e-42d3-b78c-b594aea00353+8:2359:x1875643164885760:12345-192.168.203.5@tcp:3:cat.0 Request processed in 506us (778us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788752977.836603:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00002000:00100000:0.0:1788752977.836612:0:6694:0:(ofd_dev.c:2713:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9c9a8704fb80 x1875643164885760/t0(0) o3->240b527c-392e-42d3-b78c-b594aea00353@192.168.203.5@tcp:193/0 lens 488/4536 e 0 to 0 dl 1788752988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788752977.836620:0:6694:0:(ofd_dev.c:2569:ofd_prolong_extent_locks()) Prolong locks for req ffff9c9a8704fb80 with x1875643164885760 ext(0->4095) 00002000:00010000:0.0:1788752977.836624:0:6694:0:(ofd_dev.c:2718:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c9a8704fb80 00010000:00010000:0.0:1788752978.864260:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788752979.114820:0:6882:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378848693104ns, next at 379848689799ns, rc = 0 00000100:00100000:0.0:1788752979.117238:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182688640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788752979.117356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752979.117603:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182688640 00000100:00100000:1.0:1788752979.117615:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182688640 00000100:00100000:1.0:1788752979.117758:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788752979.117771:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182688640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788752979.117819:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752979.117878:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182688640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752979.117886:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788752979.119814:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182688640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788752979.121894:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788752979.673195:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000004:00080000:1.0:1788752979.673227:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1788752979.673256:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788752979.673279:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788752979.673316:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9baf0b93c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788752979.673322:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bbddfe000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9baf0b90c0 00000020:00080000:1.0:1788752979.673326:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c9bbddfef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9bbe1c8800 00000020:00080000:1.0:1788752979.673425:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788752979.673687:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1788752979.673715:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182688768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788752979.673811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752979.675364:0:12054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182688768 00000100:00100000:2.0:1788752979.675384:0:12054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182688768 00000100:00100000:2.0:1788752979.675510:0:12054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788752979.675524:0:12054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182688768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788752979.676204:0:12054:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788752979.676210:0:12054:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788752973 -> 1788752973 00002000:00010000:2.0:1788752979.676212:0:12054:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788752973 -> 1788752973 00002000:00010000:2.0:1788752979.676215:0:12054:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788752973 -> 1788752973 00002000:00010000:2.0:1788752979.676217:0:12054:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788752979.676315:0:12054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3304:x1875643182688768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 793us (2503us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788752979.676324:0:12054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000004:00080000:1.0:1788752979.676521:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9a85e01880/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788752979.676534:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182688768:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1788752979.727569:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1788752979.727594:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:3.0:1788752979.884118:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752980.138461:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182689280:0@lo:400:kworker.0 00000100:00100000:1.0:1788752980.138481:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182689152:0@lo:400:kworker.0 00000100:00100000:3.0:1788752980.138601:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182688896:0@lo:400:kworker.0 00000100:00100000:0.0:1788752980.138652:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182689024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788752980.140934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752980.141976:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689152 00000100:00100000:1.0:1788752980.141978:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752980.141990:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689152 00000100:00100000:2.0:1788752980.142039:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689280 00000100:00100000:2.0:1788752980.142043:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689280 00000100:00100000:2.0:1788752980.142079:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1788752980.142080:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752980.142090:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182689152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752980.142106:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788752980.142116:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182689280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752980.142367:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752980.145658:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182689152:12345-0@lo:400:kworker.0 Request processed in 3559us (4724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752980.145690:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788752980.149032:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182689280:12345-0@lo:400:kworker.0 Request processed in 6908us (7045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752980.149047:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788752980.149177:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182689280:0@lo:400:kworker.0 00000100:00100000:1.0:1788752980.149246:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182689152:0@lo:400:kworker.0 00000100:00100000:1.0:1788752980.149297:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689024 00000100:00100000:1.0:1788752980.149321:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689024 00000100:00100000:1.0:1788752980.149374:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788752980.149384:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182689024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788752980.149426:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752980.149479:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182689024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (7120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752980.149499:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788752980.149523:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752980.150241:0:3306:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788752980.150257:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9b88b2f800, transno 4294967307 00000004:00080000:0.0:1788752980.150660:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788752980.150757:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9bbde5f100, transno 4294967310 00000100:00100000:0.0:1788752980.150787:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182689024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752980.150916:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182689536:0@lo:400:kworker.0 00000100:00100000:0.0:1788752980.151007:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752980.151066:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689536 00000100:00100000:0.0:1788752980.151075:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689536 00000100:00100000:0.0:1788752980.151171:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788752980.151183:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182689536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752980.151249:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182689536:12345-0@lo:400:kworker.0 Request processed in 68us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752980.151257:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788752980.151307:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182689536:0@lo:400:kworker.0 00000100:00100000:3.0:1788752980.154062:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752980.154148:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182689408:0@lo:400:kworker.0 00000100:00100000:3.0:1788752980.154200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752980.154342:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182688896 00000100:00100000:1.0:1788752980.154354:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182688896 00000100:00100000:1.0:1788752980.154411:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788752980.154421:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182688896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752980.154503:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182688896:12345-0@lo:400:kworker.0 Request processed in 82us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752980.154511:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1788752980.157251:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182688896:0@lo:400:kworker.0 00000100:00100000:0.0:1788752980.157982:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689408 00000100:00100000:0.0:1788752980.157992:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689408 00000100:00100000:0.0:1788752980.158060:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788752980.158072:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182689408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788752980.158229:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752980.158709:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182689408:12345-0@lo:400:kworker.0 Request processed in 635us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752980.158717:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788752980.158919:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182689408:0@lo:400:kworker.0 00000100:00100000:3.0:1788752980.276219:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752980.276330:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752980.276354:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752980.276377:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752980.276411:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752980.279198:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164885888 00000100:00100000:2.0:1788752980.279217:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164885888 00000100:00100000:3.0:1788752980.279260:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164886016 00000100:00100000:3.0:1788752980.279265:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164886016 00000100:00100000:3.0:1788752980.279329:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164886400 00000100:00100000:3.0:1788752980.279332:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164886400 00000100:00100000:3.0:1788752980.279365:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:3.0:1788752980.279376:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+18:2361:x1875643164886016:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752980.279414:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 291 00000100:00100000:2.0:1788752980.279422:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164885888:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752980.279463:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:240b527c-392e-42d3-b78c-b594aea00353+18:2361:x1875643164886016:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 89us (3132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752980.279471:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 145 00000100:00100000:3.0:1788752980.279500:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:3.0:1788752980.279507:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164886400:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752980.279511:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164886272 00000100:00100000:1.0:1788752980.279516:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164886272 00000100:00100000:1.0:1788752980.279558:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164886144 00000100:00100000:1.0:1788752980.279561:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164886144 00000100:00100000:1.0:1788752980.279587:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:1.0:1788752980.279594:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164886272:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788752980.283225:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:0.0:1788752980.283258:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164886144:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752980.285672:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164885888:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6234us (9451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752980.285691:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 291 00000100:00080000:2.0:1788752980.286221:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788752980.286230:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788752980.286234:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752980.292018:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164886400:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 12494us (15589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752980.292038:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 146 00000100:00100000:0.0:1788752980.295329:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164886144:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 12077us (18938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752980.295350:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:1.0:1788752980.295572:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2361:x1875643164886272:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 15706us (18944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752980.295585:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00010000:00010000:0.0:1788752980.907416:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752981.930413:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752982.613851:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752982.614373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164886528 00000100:00100000:2.0:1788752982.614386:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164886528 00000100:00080000:1.0:1788752982.614501:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752982.614560:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 237 00000100:00100000:2.0:1788752982.614574:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+18:11293:x1875643164886528:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788752982.614690:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+18:11293:x1875643164886528:12345-192.168.203.5@tcp:60:lhsmtool_posix.0 Request processed in 118us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752982.614698:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 237 00000100:00100000:3.0:1788752982.619461:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752982.620351:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164886784 00000100:00100000:1.0:1788752982.620364:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164886784 00000100:00100000:1.0:1788752982.620462:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 65 00000100:00100000:1.0:1788752982.620483:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+18:11293:x1875643164886784:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788752982.620830:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+19:11293:x1875643164886784:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 358us (1379us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788752982.620838:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 65 00010000:00010000:3.0:1788752982.954526:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752983.984259:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752984.236606:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788752984.236641:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182689664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788752984.236744:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752984.236929:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689664 00000100:00100000:0.0:1788752984.236939:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689664 00000100:00100000:0.0:1788752984.237016:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788752984.237028:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182689664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788752984.237074:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752984.237159:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875643182689664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752984.237166:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788752984.237323:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1788752984.237331:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1788752984.237365:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9a85e01880 x1875643182688768/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788752995 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788752984.237386:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182689664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788752984.237492:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788752984.407496:0:12853:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:49:43 (1788752983) 00000001:00080000:0.0:1788752984.821863:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1788752984.874350:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788752984.874375:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788752984.874465:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788752984.874480:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788752985.003313:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788752985.004939:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788752985.004947:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788752985.006508:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:1.0:1788752985.006524:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788752985.258431:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182689920:0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.258518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752985.258582:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182690432:0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.258606:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752985.258640:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788752985.258646:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182690048:0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.258666:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752985.258696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689920 00000100:00100000:0.0:1788752985.258704:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689920 00000100:00100000:0.0:1788752985.258750:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690048 00000100:00100000:0.0:1788752985.258753:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690048 00000100:00100000:0.0:1788752985.258785:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788752985.258793:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182689920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.258850:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182689920:12345-0@lo:400:kworker.0 Request processed in 56us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752985.258857:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788752985.258882:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788752985.258887:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182690048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.258914:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182690048:12345-0@lo:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752985.258920:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788752985.258937:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690432 00000100:00100000:0.0:1788752985.258941:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690432 00000100:00100000:0.0:1788752985.258966:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788752985.258971:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182690432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.258997:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182690432:12345-0@lo:400:kworker.0 Request processed in 27us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752985.259004:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788752985.259025:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788752985.259029:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752985.259061:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182690048:0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.259071:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182689920:0@lo:400:kworker.0 00000100:00100000:0.0:1788752985.259080:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182690432:0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259235:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182690176:0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259267:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752985.259288:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788752985.259301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182689792:0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752985.259349:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182690304:0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752985.259392:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690176 00000100:00100000:2.0:1788752985.259396:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690176 00000100:00100000:2.0:1788752985.259422:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788752985.259427:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182690176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259473:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182690176:12345-0@lo:400:kworker.0 Request processed in 45us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752985.259479:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788752985.259499:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182689792 00000100:00100000:2.0:1788752985.259503:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182689792 00000100:00100000:2.0:1788752985.259535:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788752985.259541:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182689792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259571:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182689792:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752985.259577:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788752985.259613:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182689792:0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259624:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788752985.259630:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c9a85e01880, transno 4294967324 00000100:00100000:2.0:1788752985.259642:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182690176:0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.259963:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690304 00000100:00100000:2.0:1788752985.259969:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690304 00000100:00100000:2.0:1788752985.259999:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788752985.260004:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182690304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788752985.260045:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875643182690304:12345-0@lo:400:kworker.0 Request processed in 41us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752985.260052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788752985.260067:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752985.260085:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182690304:0@lo:400:kworker.0 00000100:00100000:3.0:1788752985.260470:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182690560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752985.260509:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752985.260677:0:9196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690560 00000100:00100000:1.0:1788752985.260684:0:9196:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690560 00000100:00100000:1.0:1788752985.260724:0:9196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788752985.260732:0:9196:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182690560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788752985.260759:0:9196:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788752985.260801:0:9196:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182690560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752985.260807:0:9196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788752985.260843:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182690560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788752985.396868:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752985.396914:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752985.396924:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164887040 00000100:00100000:2.0:1788752985.396935:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164887040 00000100:00100000:3.0:1788752985.396948:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752985.396972:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752985.397001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752985.397031:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164887296 00000100:00100000:3.0:1788752985.397036:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164887296 00000100:00100000:3.0:1788752985.397068:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164887168 00000100:00100000:3.0:1788752985.397071:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164887168 00000100:00100000:3.0:1788752985.397095:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:3.0:1788752985.397104:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2360:x1875643164887296:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752985.397199:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+5:2360:x1875643164887296:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 95us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752985.397207:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:3.0:1788752985.397224:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:3.0:1788752985.397236:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164887168:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752985.397238:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164887424 00000100:00100000:2.0:1788752985.397244:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164887424 00000100:00100000:3.0:1788752985.397283:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:240b527c-392e-42d3-b78c-b594aea00353+7:2360:x1875643164887168:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752985.397284:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:3.0:1788752985.397295:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:2.0:1788752985.397301:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+18:2360:x1875643164887040:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752985.397319:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164886912 00000100:00100000:3.0:1788752985.397323:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164886912 00000100:00100000:3.0:1788752985.397346:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 293 00000100:00100000:3.0:1788752985.397353:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164886912:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752985.397379:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba019bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2360:x1875643164886912:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752985.397385:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 293 00000100:00100000:2.0:1788752985.397415:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:240b527c-392e-42d3-b78c-b594aea00353+18:2360:x1875643164887040:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 118us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752985.397421:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00100000:2.0:1788752985.397429:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 150 00000100:00100000:3.0:1788752985.397433:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164887424:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788752985.397474:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2360:x1875643164887424:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752985.397481:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 151 00000100:00080000:2.0:1788752985.397482:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788752985.397487:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788752985.397490:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788752986.026588:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752986.959721:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752986.960488:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164887552 00000100:00100000:2.0:1788752986.960500:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164887552 00000100:00100000:2.0:1788752986.960570:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 238 00000100:00100000:2.0:1788752986.960591:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:12312:x1875643164887552:12345-192.168.203.5@tcp:101:lsof.0 00010000:00010000:2.0:1788752986.960615:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788752986.960638:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f2ee expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752986.960708:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490d7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752986.960736:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752986.960751:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788752986.960789:0:7899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788752986.960794:0:7899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788752986.960848:0:7899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752986.960875:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0a00/0x80c8383f48490d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2ee expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752986.960894:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490d7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2ee expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752986.960904:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:2.0:1788752986.960907:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788752986.960910:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0000, rc 0) 00000100:00100000:2.0:1788752986.960977:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:12312:x1875643164887552:12345-192.168.203.5@tcp:101:lsof.0 Request processed in 397us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752986.960984:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 238 00010000:00010000:0.0:1788752987.053190:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752988.075262:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752988.850005:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752988.850118:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164887808 00000100:00100000:1.0:1788752988.850171:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164887808 00000100:00100000:1.0:1788752988.850264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00100000:1.0:1788752988.850277:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+18:12314:x1875643164887808:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:1.0:1788752988.850686:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+19:12314:x1875643164887808:12345-192.168.203.5@tcp:35:umount.0 Request processed in 410us (690us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788752988.850709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 66 00000100:00080000:2.0:1788752988.850724:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788752988.853979:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752988.854181:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164888064 00000100:00100000:0.0:1788752988.854192:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164888064 00000100:00100000:0.0:1788752988.854257:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:0.0:1788752988.854267:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+19:12314:x1875643164888064:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:0.0:1788752988.854649:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+20:12314:x1875643164888064:12345-192.168.203.5@tcp:35:umount.0 Request processed in 382us (678us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788752988.854657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 67 00000100:00100000:3.0:1788752988.858639:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752988.858877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164888320 00000100:00100000:0.0:1788752988.858888:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164888320 00000100:00100000:0.0:1788752988.859008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:0.0:1788752988.859026:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b8f737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+20:12314:x1875643164888320:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:0.0:1788752988.859371:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b8f737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:240b527c-392e-42d3-b78c-b594aea00353+21:12314:x1875643164888320:12345-192.168.203.5@tcp:35:umount.0 Request processed in 346us (742us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788752988.859380:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 68 00000100:00100000:3.0:1788752988.862232:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752988.862674:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164888576 00000100:00100000:1.0:1788752988.862685:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164888576 00000100:00100000:1.0:1788752988.862760:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:1.0:1788752988.862771:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+21:12314:x1875643164888576:12345-192.168.203.5@tcp:35:umount.0 00000100:00100000:1.0:1788752988.863208:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:240b527c-392e-42d3-b78c-b594aea00353+22:12314:x1875643164888576:12345-192.168.203.5@tcp:35:umount.0 Request processed in 438us (985us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788752988.863217:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 69 00000100:00100000:3.0:1788752988.866670:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752988.866716:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752988.866843:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164888832 00000100:00100000:0.0:1788752988.866857:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164888832 00000100:00100000:2.0:1788752988.866869:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164888704 00000100:00100000:2.0:1788752988.866875:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164888704 00000100:00100000:0.0:1788752988.866932:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:0.0:1788752988.866946:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+14:2361:x1875643164888832:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788752988.866947:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:2.0:1788752988.866963:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+14:2361:x1875643164888704:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752988.866970:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752988.866990:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752988.866992:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2172400/0x80c8383f4848fd66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee48 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752988.867004:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bbe270000/0x80c8383f4848fd9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee80 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752988.867023:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752988.867082:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+13:2361:x1875643164888704:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 122us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752988.867090:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00010000:00010000:0.0:1788752988.869028:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752988.869110:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:2361:x1875643164888832:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 2164us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752988.869134:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:3.0:1788752988.873075:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752988.873361:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752988.873653:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164889088 00000100:00100000:0.0:1788752988.873665:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164889088 00000100:00100000:0.0:1788752988.873739:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:0.0:1788752988.873750:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:2358:x1875643164889088:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788752988.873768:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788752988.873791:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bbe271c00/0x80c8383f4848ffea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef4b expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752988.873824:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788752988.873925:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2358:x1875643164889088:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 177us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752988.873933:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:2.0:1788752988.874470:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164888960 00000100:00100000:2.0:1788752988.874477:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164888960 00000100:00100000:2.0:1788752988.874592:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 73 00000100:00100000:2.0:1788752988.874602:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+5:2357:x1875643164888960:12345-192.168.203.5@tcp:9:umount.0 00000020:00000080:2.0:1788752988.874628:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f484900d8 00000100:00080000:2.0:1788752988.874638:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9c9b8941c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788752988.874677:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788752988.874944:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:240b527c-392e-42d3-b78c-b594aea00353+2:2357:x1875643164888960:12345-192.168.203.5@tcp:9:umount.0 Request processed in 342us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752988.874951:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 73 00010000:00010000:2.0:1788752988.874974:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788752988.876902:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788752988.882006:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752988.882193:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164889472 00000100:00100000:0.0:1788752988.882207:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164889472 00000100:00100000:0.0:1788752988.882289:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:0.0:1788752988.882301:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+7:2357:x1875643164889472:12345-192.168.203.5@tcp:9:umount.0 00000020:00000080:0.0:1788752988.882336:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f48490339 00000020:00010000:0.0:1788752988.882345:0:6690:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c9b9192e800: total 0 00000100:00080000:0.0:1788752988.882350:0:6690:0:(import.c:65:import_set_state_nolock()) ffff9c9b91928800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788752988.882408:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1788752988.882779:0:6704:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c9b9192e800: total 0 00010000:00010000:2.0:1788752988.882820:0:6704:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c9b9192e800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788752988.882881:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cdeab26/0x80c8383f484906dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f120 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752988.882920:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000674bf9c/0x80c8383f48490d6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2e7 expref: 5 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752988.882955:0:6704:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c9b9192e800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788752988.882968:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752988.882971:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752988.882972:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788752988.883291:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788752988.883559:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:240b527c-392e-42d3-b78c-b594aea00353+2:2357:x1875643164889472:12345-192.168.203.5@tcp:9:umount.0 Request processed in 1259us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752988.883577:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:1.0:1788752988.894625:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752988.894837:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164890496 00000100:00100000:2.0:1788752988.894848:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164890496 00000100:00100000:2.0:1788752988.894966:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 239 00000100:00100000:2.0:1788752988.894976:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+22:2357:x1875643164890496:12345-192.168.203.5@tcp:39:umount.0 00000020:00000080:2.0:1788752988.895014:0:5832:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fd74 00000020:00010000:2.0:1788752988.895044:0:5832:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c9b88ac0800: total 0 00000100:00080000:2.0:1788752988.895048:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9c9b88ac3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788752988.895083:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788752988.895502:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:240b527c-392e-42d3-b78c-b594aea00353+21:2357:x1875643164890496:12345-192.168.203.5@tcp:39:umount.0 Request processed in 526us (889us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788752988.895510:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 239 00000020:00010000:3.0:1788752988.895584:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c9b88ac0800: total 0 00010000:00010000:3.0:1788752988.895646:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c9b88ac0800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788752988.895685:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752988.895689:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788752988.895698:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f4849039b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f047 expref: 20 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895718:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752988.895720:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752988.895725:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85928a00/0x80c8383f484905bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f0d3 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895740:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752988.895742:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752988.895747:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f48490d2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2d2 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895758:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c9b9424bc00) 00010000:00010000:3.0:1788752988.895760:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788752988.895764:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9e00/0x80c8383f484900ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef75 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895781:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:3.0:1788752988.895783:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788752988.895786:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f48490730 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f135 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895821:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752988.895824:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788752988.895828:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48490d57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2e0 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895841:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752988.895843:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788752988.895847:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270800/0x80c8383f48490a2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f20e expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895860:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c9b94cc6c00) 00010000:00010000:3.0:1788752988.895862:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788752988.895865:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48490c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f29a expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895880:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c9ba049d200) 00010000:00010000:3.0:1788752988.895882:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788752988.895885:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9ba3b2cc00/0x80c8383f4849074c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f13c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895897:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9b89426500) 00010000:00010000:3.0:1788752988.895899:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788752988.895902:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b85929600/0x80c8383f4849005a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef60 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895914:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752988.895916:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788752988.895925:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f4849069d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f10b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895938:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c9ba3667300) 00010000:00010000:3.0:1788752988.895940:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788752988.895943:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bbe270a00/0x80c8383f4849003e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef59 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895955:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9b9424b800) 00010000:00010000:3.0:1788752988.895957:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788752988.895961:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8400/0x80c8383f484906c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f119 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752988.895972:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c9b88ac0800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788752988.895983:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752988.895986:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752988.895987:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788752989.098356:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752989.354680:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182690688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788752989.354760:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752989.355002:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690688 00000100:00100000:3.0:1788752989.355013:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690688 00000100:00100000:3.0:1788752989.355091:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788752989.355103:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb54de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182690688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788752989.355177:0:6692:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788752989.355635:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788752989.356283:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb54de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182690688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1180us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752989.356293:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788752989.361780:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182690688:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788752989.922792:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00080000:3.0:1788752989.922811:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1788752989.922822:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000001:00080000:3.0:1788752989.922827:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788752989.922845:0:5855:0:(genops.c:885:class_export_put()) final put ffff9c9b88ac0800/240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:3.0:1788752989.922871:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88ac0800/240b527c-392e-42d3-b78c-b594aea00353 for lustre-MDT0000 00000020:00000080:3.0:1788752989.922928:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b88ac3000 for lustre-MDT0000 00000001:00100000:2.0:1788752989.923147:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:2.0:1788752989.923152:0:6714:0:(genops.c:885:class_export_put()) final put ffff9c9b9192e800/240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:2.0:1788752989.923180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b9192e800/240b527c-392e-42d3-b78c-b594aea00353 for lustre-OST0000 00000020:00000080:2.0:1788752989.923208:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b91928800 for lustre-OST0000 00010000:00010000:2.0:1788752990.122565:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752990.378580:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182690816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752990.378669:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788752990.379267:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690816 00000100:00100000:0.0:1788752990.379275:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690816 00000100:00100000:0.0:1788752990.379329:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788752990.379338:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182690816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788752990.379370:0:6693:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788752990.379434:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182690816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788752990.379464:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788752990.379491:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788752990.379532:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182690816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788752990.379597:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788752990.379605:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182691328:0@lo:400:kworker.0 00000100:00100000:3.0:1788752990.379618:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182690944:0@lo:400:kworker.0 00000100:00100000:3.0:1788752990.379707:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752990.379738:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182691456:0@lo:400:kworker.0 00000100:00100000:2.0:1788752990.379854:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182690944 00000100:00100000:2.0:1788752990.379866:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182690944 00000100:00100000:2.0:1788752990.379893:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788752990.379899:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182690944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788752990.380889:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182691072:0@lo:400:kworker.0 00000100:00100000:1.0:1788752990.381018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752990.381259:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752990.381319:0:9256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691328 00000100:00100000:3.0:1788752990.381326:0:9256:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691328 00000100:00100000:3.0:1788752990.381372:0:9256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788752990.381382:0:9256:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182691328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788752990.381451:0:9256:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182691328:12345-0@lo:400:kworker.0 Request processed in 70us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752990.381458:0:9256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788752990.381562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691456 00000100:00100000:3.0:1788752990.381566:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691456 00000100:00100000:3.0:1788752990.381604:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788752990.381611:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182691456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752990.381714:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182691328:0@lo:400:kworker.0 00000100:00100000:1.0:1788752990.381724:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182691200:0@lo:400:kworker.0 00000100:00100000:1.0:1788752990.381755:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752990.381804:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691200 00000100:00100000:1.0:1788752990.381808:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691200 00000100:00100000:1.0:1788752990.381846:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788752990.381854:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182691200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752990.381891:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875643182691200:12345-0@lo:400:kworker.0 Request processed in 38us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752990.381897:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788752990.381925:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182691200:0@lo:400:kworker.0 00000100:00080000:1.0:1788752990.382377:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788752990.383812:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90826050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182690944:12345-0@lo:400:kworker.0 Request processed in 3908us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752990.383826:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788752990.383893:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182690944:0@lo:400:kworker.0 00000100:00100000:0.0:1788752990.384194:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752990.384304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691072 00000100:00100000:1.0:1788752990.384314:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691072 00000100:00100000:1.0:1788752990.384354:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788752990.384376:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182691072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788752990.384450:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182691072:12345-0@lo:400:kworker.0 Request processed in 77us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752990.384457:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788752990.384491:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182691072:0@lo:400:kworker.0 00000100:00100000:3.0:1788752990.385684:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182691456:12345-0@lo:400:kworker.0 Request processed in 4068us (4420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752990.385696:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788752990.385906:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182691456:0@lo:400:kworker.0 00000001:00100000:1.0:1788752990.447878:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:1.0:1788752990.447890:0:7625:0:(genops.c:885:class_export_put()) final put ffff9c9b89418800/240b527c-392e-42d3-b78c-b594aea00353 00000020:00000080:2.0:1788752990.448023:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b89418800/240b527c-392e-42d3-b78c-b594aea00353 for lustre-OST0001 00000020:00000080:2.0:1788752990.448082:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b8941c800 for lustre-OST0001 00000100:00100000:3.0:1788752990.518707:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788752990.518766:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752990.518881:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164890624 00000100:00100000:2.0:1788752990.518893:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164890624 00000100:00100000:2.0:1788752990.518953:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 295 00000100:00100000:2.0:1788752990.518964:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2361:x1875643164890624:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788752990.519063:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90827c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2361:x1875643164890624:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 92us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752990.519072:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 295 00000100:00100000:1.0:1788752990.519262:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164890752 00000100:00100000:1.0:1788752990.519267:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164890752 00000100:00100000:1.0:1788752990.519323:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00100000:1.0:1788752990.519332:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:2361:x1875643164890752:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788752990.519365:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:2361:x1875643164890752:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 34us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752990.519371:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 155 00000100:00080000:0.0:1788752990.519436:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788752990.981644:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752990.981692:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788752990.981730:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752990.981897:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164890880 00000100:00100000:1.0:1788752990.981908:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164890880 00000100:00100000:1.0:1788752990.981971:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164891136 00000100:00100000:1.0:1788752990.981974:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164891136 00000100:00100000:1.0:1788752990.981988:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164891008 00000100:00100000:1.0:1788752990.981990:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164891008 00000100:00100000:1.0:1788752990.982006:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:1.0:1788752990.982016:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+12:2358:x1875643164890880:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752990.982034:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752990.982068:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc9200/0x80c8383f4848fe46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee95 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752990.982086:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752990.982425:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+11:2358:x1875643164890880:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 201us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752990.982435:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:1.0:1788752990.982454:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:1.0:1788752990.982461:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+10:2358:x1875643164891136:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752990.982470:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752990.982480:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2de00/0x80c8383f4848ffe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ef44 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752990.982489:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752990.982510:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+9:2358:x1875643164891136:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 50us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752990.982516:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:1.0:1788752990.982529:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:1.0:1788752990.982535:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+8:2358:x1875643164891008:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788752990.982542:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788752990.982550:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bbe270e00/0x80c8383f4848fe4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852eebf expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752990.982560:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788752990.982577:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+7:2358:x1875643164891008:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 43us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752990.982582:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:3.0:1788752990.998467:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788752990.998600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164891392 00000100:00100000:1.0:1788752990.998629:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164891392 00000100:00100000:1.0:1788752990.998718:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 240 00000100:00100000:1.0:1788752990.998730:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+6:2357:x1875643164891392:12345-192.168.203.5@tcp:39:umount.0 00000020:00000080:1.0:1788752990.998790:0:5835:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fe5b 00000020:00010000:1.0:1788752990.998799:0:5835:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c9b88aa4800: total 0 00000100:00080000:1.0:1788752990.998804:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9c9b88aa5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788752990.998840:0:5835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1788752991.000089:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d6fb571c-e1e0-40af-9c1e-57602ced3328+5:2357:x1875643164891392:12345-192.168.203.5@tcp:39:umount.0 Request processed in 1354us (1633us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1788752991.000101:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 240 00000020:00010000:0.0:1788752991.000403:0:5821:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c9b88aa4800: total 0 00010000:00010000:0.0:1788752991.000408:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752991.000463:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c9b88aa4800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788752991.000498:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b91646a00) 00010000:00010000:0.0:1788752991.000501:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788752991.000509:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48490d7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f2ee expref: 4 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752991.000530:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c9b88aa4800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788752991.000540:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752991.000542:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752991.000544:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788752991.019983:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788752991.020180:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164891648 00000100:00100000:2.0:1788752991.020193:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164891648 00000100:00100000:2.0:1788752991.020265:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 296 00000100:00100000:2.0:1788752991.020279:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+7:2357:x1875643164891648:12345-192.168.203.5@tcp:251:umount.0 00000020:00000080:2.0:1788752991.020352:0:5825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fd51 00000020:00010000:2.0:1788752991.020362:0:5825:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c9b88ac5800: total 0 00000100:00080000:2.0:1788752991.020369:0:5825:0:(import.c:65:import_set_state_nolock()) ffff9c9b88ac5000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788752991.020559:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b90824850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e1aa3116-88bb-4258-bb6d-88e2aff8c3a6+3:2357:x1875643164891648:12345-192.168.203.5@tcp:251:umount.0 Request processed in 281us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752991.020591:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 296 00000020:00010000:0.0:1788752991.022616:0:5822:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c9b88ac5800: total 0 00010000:00010000:0.0:1788752991.022717:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c9b88ac5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788752991.022769:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2c400/0x80c8383f4848fda5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852ee87 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752991.022816:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c9b88ac5800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788752991.022828:0:5822:0:(genops.c:885:class_export_put()) final put ffff9c9b88ac5800/e1aa3116-88bb-4258-bb6d-88e2aff8c3a6 00010000:00010000:0.0:1788752991.022891:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752991.022894:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752991.022895:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788752991.027456:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88ac5800/e1aa3116-88bb-4258-bb6d-88e2aff8c3a6 for MGS 00000020:00000080:2.0:1788752991.027551:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b88ac5000 for MGS 00010000:00010000:2.0:1788752991.147398:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752992.172653:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788752992.899443:0:13052:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788752992.917055:0:13052:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788752992.917105:0:13052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.918210:0:13052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.918228:0:13052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.918236:0:13052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.918257:0:13052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788752992.918264:0:13052:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788752992.918292:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788752992.918297:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788752992.918304:0:13052:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788752992.918330:0:13052:0:(import.c:65:import_set_state_nolock()) ffff9c9b8f7a4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788752992.921452:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752992.921469:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.921605:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8c00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752992.921610:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.921621:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752992.921630:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752992.921637:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788752992.921639:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788752992.921644:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788752992.921694:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.921702:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752992.921742:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.921768:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8c00/0x80c8383f4848fde4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdeb expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.921781:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752992.921783:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752992.921784:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752992.921807:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182691584:0@lo:39:umount.0 00000100:00100000:2.0:1788752992.921907:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788752992.921925:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182691712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788752992.921982:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752992.922343:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691712 00000100:00100000:3.0:1788752992.922352:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691712 00000100:00100000:3.0:1788752992.922440:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788752992.922452:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3305:x1875643182691712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788752992.922466:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788752992.922482:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bbe271a00/0x80c8383f4848fdeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fde4 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.922495:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788752992.922540:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3305:x1875643182691712:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788752992.922547:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788752992.922600:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b577cb32-91f9-472d-9b00-c1edbc016b63:3305:1875643182691712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788752992.923919:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788752992.923973:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691584 00000100:00100000:1.0:1788752992.923982:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691584 00000100:00100000:1.0:1788752992.924102:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788752992.924113:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875643182691584:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788752992.924637:0:7899:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fb60 00000100:00080000:1.0:1788752992.924648:0:7899:0:(import.c:65:import_set_state_nolock()) ffff9c9ba0015000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788752992.924727:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3302:x1875643182691584:12345-0@lo:39:umount.0 Request processed in 615us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752992.924736:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1788752992.924747:0:7899:0:(genops.c:885:class_export_put()) final put ffff9c9ba0010800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788752992.924748:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788752992.924774:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9ba0010800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788752992.924815:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9ba0015000 for lustre-MDT0000 00000100:00080000:1.0:1788752992.924852:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b8f7a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788752992.924874:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182691584:0@lo:39:umount.0 00000100:00080000:3.0:1788752992.925319:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788752992.925323:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788752992.925330:0:13052:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788752992.927221:0:13052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927239:0:13052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927247:0:13052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927254:0:13052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927451:0:13052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788752992.927459:0:13052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.927518:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752992.927527:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.927535:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2c800 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752992.927540:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.927549:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752992.927556:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752992.927562:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788752992.927564:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788752992.927592:0:13052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927598:0:13052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927605:0:13052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.927609:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.927617:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788752992.927668:0:13052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788752992.927675:0:13052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927682:0:13052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927687:0:13052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.927693:0:13052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.928036:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.928044:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c800/0x80c8383f4848fdf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdf9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.928057:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788752992.928061:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.928067:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752992.928070:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.928077:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752992.928082:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752992.928087:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788752992.928089:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788752992.928091:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788752992.928107:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.928113:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752992.928120:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788752992.928905:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182691840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788752992.929003:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752992.929066:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788752992.929074:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182691968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788752992.929097:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788752992.929157:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691840 00000100:00100000:2.0:1788752992.929166:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691840 00010000:00010000:0.0:1788752992.929430:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b85928400/0x80c8383f4848fd0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fd12 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.929466:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788752992.929471:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.929477:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271000 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788752992.929480:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.929489:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788752992.929496:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788752992.929501:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788752992.929504:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788752992.929536:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.929542:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788752992.929567:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788752992.929576:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788752992.929578:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752992.929631:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752992.929648:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788752992.929650:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182691968 00000100:00100000:2.0:1788752992.929656:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182691968 00000100:00100000:1.0:1788752992.929662:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182692096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788752992.929685:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788752992.929696:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba001c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+19:3303:x1875643182691840:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752992.929704:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788752992.929712:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752992.929734:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85929400/0x80c8383f4848fdf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fdf2 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.929749:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752992.929927:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba001c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3303:x1875643182691840:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752992.929935:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788752992.929987:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182692096 00000100:00100000:2.0:1788752992.929991:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182692096 00000100:00100000:2.0:1788752992.930008:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788752992.930014:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+18:3303:x1875643182691968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788752992.930021:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752992.930030:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173200/0x80c8383f4848fd12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fd0b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.930041:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752992.930065:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+17:3303:x1875643182691968:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752992.930079:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788752992.930093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788752992.930099:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+16:3306:x1875643182692096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788752992.930106:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752992.930115:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bbe270200/0x80c8383f48490014 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4849000d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.930145:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752992.930174:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:3306:x1875643182692096:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752992.930181:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788752992.930340:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182691840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752992.930367:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182691968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788752992.930393:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182692096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788752992.930819:0:13052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788752992.930828:0:13052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271000/0x80c8383f4849000d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f48490014 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788752992.930843:0:13052:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788752992.930845:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788752992.930871:0:13052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.930889:0:13052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.930897:0:13052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.930904:0:13052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788752992.930922:0:13052:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788752992.930926:0:13052:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788752992.930932:0:13052:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788752992.930967:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:3.0:1788752992.930969:0:13052:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788752992.930975:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:1.0:1788752992.930975:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788752992.930983:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1788752992.930986:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d000 already unused, calling callback (ffffffffc1b05c20) 00000020:00000080:3.0:1788752992.930992:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 10000000:00010000:1.0:1788752992.930992:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788752992.931002:0:13052:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c9a842b0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788752992.931005:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788752992.931014:0:13052:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9c9a849f6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1788752992.931018:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788752992.931025:0:13052:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9c9b88aa4800 d6fb571c-e1e0-40af-9c1e-57602ced3328 192.168.203.5@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 10000000:01000000:1.0:1788752992.931027:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788752992.931032:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788752992.931034:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788752992.931065:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752992.931070:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788752992.931139:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182692224:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788752992.931165:0:13052:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9c9bbe564d40) has exports, disconnecting them 00000020:00080000:3.0:1788752992.931170:0:13052:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c9a842b0800), last request at 1788752990 00000020:00000080:3.0:1788752992.931179:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fcd3 00000100:00080000:3.0:1788752992.931196:0:13052:0:(import.c:65:import_set_state_nolock()) ffff9c9a842b0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788752992.931266:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788752992.931269:0:13052:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c9a842b0800): rc 0 00000020:00000080:3.0:1788752992.931274:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9a842b0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788752992.931289:0:13052:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c9a849f6800), last request at 1788752990 00000020:00000080:3.0:1788752992.931293:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fc08 00010000:00010000:1.0:1788752992.931347:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752992.931355:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d000/0x80c8383f4848fabf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fac6 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752992.931382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752992.931384:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752992.931386:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788752992.931396:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a842b0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:3.0:1788752992.931448:0:13052:0:(import.c:65:import_set_state_nolock()) ffff9c9a849f7000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788752992.931449:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9a842b0000 for lustre-MDT0000 00000020:00080000:3.0:1788752992.931465:0:13052:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c9a849f6800): rc 0 00000020:00000080:3.0:1788752992.931468:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9a849f6800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1788752992.931592:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1788752992.931654:0:13052:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffab8a01803ae0 00010000:00010000:0.0:1788752992.931732:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788752992.931742:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788752992.931747:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788752992.931767:0:13052:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1788752992.931781:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a849f6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788752992.931822:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9a849f7000 for lustre-MDT0000 00000100:00080000:3.0:1788752992.931838:0:13052:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788752992.931853:0:13052:0:(import.c:65:import_set_state_nolock()) ffff9c9ba0106000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788752992.931875:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788752992.931878:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788752992.931891:0:13052:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788752992.931896:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182692352:0@lo:9:umount.0 00000100:00100000:1.0:1788752992.931939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788752992.931950:0:13052:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788752992.931961:0:13052:0:(import.c:65:import_set_state_nolock()) ffff9c9b9149a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788752992.931972:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182692480:0@lo:9:umount.0 00000100:00100000:1.0:1788752992.932001:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788752992.932002:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c9bbe564d40) has no exports 00000100:00100000:1.0:1788752992.932037:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182692352 00000100:00100000:1.0:1788752992.932044:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182692352 00000100:00100000:1.0:1788752992.932088:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182692480 00000100:00100000:1.0:1788752992.932092:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182692480 00000100:00100000:1.0:1788752992.932115:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788752992.932154:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875643182692352:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788752992.932179:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fc55 00000100:00080000:1.0:1788752992.932186:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9c9a849f5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788752992.932230:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788752992.932603:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3302:x1875643182692352:12345-0@lo:9:umount.0 Request processed in 477us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752992.932611:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788752992.932631:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788752992.932639:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875643182692480:12345-0@lo:9:umount.0 00000100:00080000:3.0:1788752992.932640:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9ba0106000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788752992.932651:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788752992.932654:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788752992.932658:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182692352:0@lo:9:umount.0 00000020:00000080:1.0:1788752992.932659:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fd3c 00000100:00080000:1.0:1788752992.932675:0:6691:0:(import.c:65:import_set_state_nolock()) ffff9c9b88ac4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788752992.932699:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788752992.932908:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3302:x1875643182692480:12345-0@lo:9:umount.0 Request processed in 270us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788752992.932915:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788752992.932936:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788752992.932939:0:5828:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788752992.933021:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752992.933027:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788752992.933156:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b9149a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788752992.933162:0:3302:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788752992.933164:0:3302:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788752992.933167:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182692480:0@lo:9:umount.0 00010000:00010000:1.0:1788752992.933341:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788752992.933474:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182692224 00000100:00100000:2.0:1788752992.933480:0:5819:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182692224 00000100:00100000:2.0:1788752992.933527:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788752992.933535:0:5819:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+15:3306:x1875643182692224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788752992.933546:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788752992.933565:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b80031400/0x80c8383f4848fac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fabf expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752992.933586:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788752992.933630:0:5819:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b577cb32-91f9-472d-9b00-c1edbc016b63+14:3306:x1875643182692224:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788752992.933636:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788752992.933700:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182692224:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788752992.942887:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9c9bbe564d40) has no exports 00000020:00000080:3.0:1788752993.001502:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fb1a 00000020:00000080:3.0:1788752993.001521:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9baec3c800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788752993.001596:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788752993.001705:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788752993.001728:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788752993.001732:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9c9b88b419c0) has no exports 00000020:00000080:2.0:1788752993.002115:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fb13 00000020:00000080:2.0:1788752993.002147:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9bbe508000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788752993.002613:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9baec3c800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788752993.002889:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbe508000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788752993.002970:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788752993.002979:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788752993.002983:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9bbe50b800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788752993.002985:0:13052:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbe50b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788752993.002993:0:13052:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788752993.194339:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752994.219752:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788752995.031355:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d6fb571c-e1e0-40af-9c1e-57602ced3328 00000001:00080000:2.0:1788752995.031371:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788752995.031376:0:5855:0:(genops.c:885:class_export_put()) final put ffff9c9b88aa4800/d6fb571c-e1e0-40af-9c1e-57602ced3328 00000020:00000080:2.0:1788752995.031411:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88aa4800/d6fb571c-e1e0-40af-9c1e-57602ced3328 for lustre-MDT0000 00000020:00000080:2.0:1788752995.031474:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b88aa5000 for lustre-MDT0000 00000001:00100000:2.0:1788752995.038716:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788752995.038725:0:6714:0:(genops.c:885:class_export_put()) final put ffff9c9a849f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788752995.038851:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a849f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788752995.038978:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9a849f5000 for lustre-OST0000 00000020:01000000:2.0:1788752995.050276:0:13052:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9b87379540 - data ffff9c9babf13a20/ffff9c9bbde19c00 00000020:01000000:2.0:1788752995.050491:0:13052:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9bb0455840 - data ffff9c9b99b16288/ffff9c9baed3bc00 00000001:00000004:3.0:1788752995.059581:0:13052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788752995.137888:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788752995.137897:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788752995.137920:0:13052:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788752995.137923:0:13052:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788752995.138318:0:6881:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788752995.138324:0:6881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788752995.138335:0:6881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788752995.139746:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788752995.139752:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788752995.139768:0:13052:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788752995.139770:0:13052:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788752995.139975:0:8074:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788752995.139979:0:8074:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788752995.139988:0:8074:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788752995.218173:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fae2 00000020:00000080:1.0:1788752995.218185:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9bae9b9800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788752995.218950:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848faf7 00000020:00000080:1.0:1788752995.218956:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9bbe571800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788752995.218962:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788752995.218968:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788752995.218975:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788752995.218979:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9c9bbe563380) has no exports 00000004:01000000:1.0:1788752995.219143:0:13052:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788752995.219151:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fd35 00000020:00000080:1.0:1788752995.219167:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9b88ac1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788752995.219171:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788752995.219174:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788752995.219180:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788752995.219182:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9c9ba0064d40) has no exports 00000020:00000080:1.0:1788752995.219188:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fd2e 00000020:00000080:1.0:1788752995.219190:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9b9149c000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788752995.219505:0:13052:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788752995.219510:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788752995.219514:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788752995.219520:0:13052:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788752995.219522:0:13052:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788752995.219548:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788752995.219555:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788752995.219560:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fc4e 00000020:00000080:1.0:1788752995.219564:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9b88a87800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788752995.219567:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788752995.219571:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788752995.219574:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788752995.219577:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9c9b873199c0) has no exports 00000020:00000080:1.0:1788752995.219581:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fc47 00000020:00000080:1.0:1788752995.219583:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9ba0107800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788752995.219882:0:13052:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788752995.219886:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788752995.219888:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788752995.219892:0:13052:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788752995.219893:0:13052:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788752995.219918:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788752995.219923:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788752995.219947:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788752995.219950:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788752995.219975:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fafe 00000020:00000080:1.0:1788752995.219985:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9bbe575800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788752995.219989:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788752995.219992:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788752995.219995:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788752995.219997:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9c9bbe560000) has no exports 00000020:00000080:1.0:1788752995.220014:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788752995.220017:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788752995.220020:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fb05 00000020:00000080:1.0:1788752995.220023:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9bbe575000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788752995.220029:0:13052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9b90a5a800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788752995.220032:0:13052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9b90a5a800 3 00000020:01000004:1.0:1788752995.220034:0:13052:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c9b90a5a800 from lustre-MDT0000 00000020:00000080:1.0:1788752995.220051:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788752995.220054:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788752995.220056:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9bae9be800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788752995.220059:0:13052:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bae9be800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788752995.220068:0:13052:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788752995.220147:0:13052:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788752995.220150:0:13052:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788752995.220153:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788752995.220155:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788752995.220158:0:13052:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788752995.220164:0:13052:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9c9b909f9000 b577cb32-91f9-472d-9b00-c1edbc016b63 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788752995.220170:0:13052:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9c9b88b40000) has exports, disconnecting them 00000020:00080000:1.0:1788752995.220174:0:13052:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c9b909f9000), last request at 1788752790 00000020:00000080:1.0:1788752995.220187:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848faa3 00000020:00010000:1.0:1788752995.220191:0:13052:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9c9b909f9000: total 8 00000100:00080000:1.0:1788752995.220194:0:13052:0:(import.c:65:import_set_state_nolock()) ffff9c9b8736d800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788752995.220210:0:13052:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c9b909f9000): rc 0 00000020:00080000:1.0:1788752995.220213:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9c9b88b40000) has no exports 00000020:00010000:1.0:1788752995.220226:0:6704:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9c9b909f9000: total 8 00010000:00010000:1.0:1788752995.220246:0:6704:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c9b909f9000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788752995.220277:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc9a00/0x80c8383f4848fdb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fdac expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220293:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b85928200/0x80c8383f4848fdc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fdba expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220304:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc9600/0x80c8383f4848fdcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fdc8 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220314:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2c000/0x80c8383f4848fddd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fdd6 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220324:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4848fff8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fff1 expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220333:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9ba3b2ca00/0x80c8383f48490006 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848ffff expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220345:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2172a00/0x80c8383f4848fbbb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fbb4 expref: 3 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220357:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bbe271400/0x80c8383f4848fe07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x80c8383f4848fe00 expref: 2 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752995.220368:0:6704:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c9b909f9000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788752995.220379:0:6704:0:(genops.c:885:class_export_put()) final put ffff9c9b909f9000/b577cb32-91f9-472d-9b00-c1edbc016b63 00010000:00010000:1.0:1788752995.220396:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752995.220398:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752995.220400:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788752995.220470:0:5827:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c9ba01f8e00:5827] 2 exiting: rc = 0 00000100:00100000:1.0:1788752995.220555:0:5826:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c9b909a1e00:5826] 1 exiting: rc = 0 00000020:00000080:0.0:1788752995.220728:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bae9b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788752995.220741:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbe571800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788752995.220749:0:36:0:(genops.c:885:class_export_put()) final put ffff9c9bbd900000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788752995.220751:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbd900000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788752995.220755:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788752995.220856:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88ac1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788752995.220862:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b9149c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788752995.220867:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b9149a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788752995.220871:0:36:0:(genops.c:885:class_export_put()) final put ffff9c9bb5104000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788752995.220873:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bb5104000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788752995.220876:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788752995.220901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88a87800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788752995.220906:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9ba0107800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788752995.220913:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9ba0106000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788752995.220916:0:36:0:(genops.c:885:class_export_put()) final put ffff9c9bb5102000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788752995.220918:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bb5102000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788752995.220921:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788752995.220988:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbe575800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788752995.220991:0:36:0:(genops.c:885:class_export_put()) final put ffff9c9bbe574800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788752995.220993:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbe574800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788752995.220997:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788752995.221184:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bbe575000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788752995.221189:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b909f9000/b577cb32-91f9-472d-9b00-c1edbc016b63 for MGS 00000020:00000080:0.0:1788752995.221219:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b8736d800 for MGS 00000100:00100000:2.0:1788752995.221481:0:5825:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c9b909a0a00:5825] 0 exiting: rc = 1 00000100:00100000:3.0:1788752995.221855:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221863:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221869:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221877:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221883:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221890:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221895:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221901:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221907:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221913:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221920:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221927:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221933:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221938:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221943:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221950:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221955:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221961:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221967:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221973:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221979:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221986:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221992:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.221999:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222005:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222031:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222036:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222042:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222047:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222052:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222057:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222062:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222068:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222073:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222078:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222083:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222088:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222093:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222099:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222104:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222110:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222114:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222148:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222156:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222161:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222168:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222173:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222179:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222185:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222189:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222194:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222199:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222204:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222213:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222218:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222224:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222229:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222238:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222244:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222250:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222264:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222269:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222275:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.222280:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788752995.222623:0:13052:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788752995.222627:0:13052:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788752995.223361:0:13052:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9b87379cc0 - data ffff9c9b90e15d80/ffff9c9bbde1ac00 00000020:01000000:3.0:1788752995.226644:0:13052:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9ba02b5a20 - data ffff9c9babd37ca8/ffff9c9b87357000 00000020:00000080:3.0:1788752995.227287:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fa87 00000020:00000080:3.0:1788752995.227296:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9ba0055000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788752995.227350:0:13052:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9b90a5a800 from MGS, refs=2 00000020:01000004:3.0:1788752995.227354:0:13052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9b90a5a800 2 00000020:01000004:3.0:1788752995.227357:0:13052:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c9b90a5a800 from MGS 00000020:00000080:3.0:1788752995.227403:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788752995.227411:0:13052:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788752995.227414:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9ba0057000/MGS 00000020:00000080:3.0:1788752995.227416:0:13052:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9ba0057000/MGS for MGS 00000020:01000000:3.0:1788752995.227424:0:13052:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788752995.227480:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788752995.227484:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788752995.227490:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788752995.227496:0:13052:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c9b8f7a0000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788752995.227502:0:13052:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9c9ba0063380) has exports, disconnecting them 00000020:00080000:3.0:1788752995.227506:0:13052:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c9b8f7a0000), last request at 1788752791 00000020:00000080:3.0:1788752995.227511:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fb52 00000020:00080000:3.0:1788752995.227520:0:13052:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c9b8f7a0000): rc 0 00000020:00000080:3.0:1788752995.227525:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9b8f7a0000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788752995.227962:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9ba0055000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788752995.229300:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b8f7a0000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788752995.230215:0:13052:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788752995.230221:0:13052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788752995.230234:0:13052:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788752995.230240:0:13052:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788752995.230406:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788752995.230414:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788752995.230421:0:13052:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9b90a5a800 1 00000020:00000080:0.0:1788752995.230427:0:13052:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fa79 00000020:00000080:0.0:1788752995.230435:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9ba0056800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788752995.230440:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788752995.230444:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788752995.230448:0:13052:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788752995.230451:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9c9ba0060000) has no exports 00000020:00000080:1.0:1788752995.230577:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b8f7a4800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788752995.230583:0:8:0:(genops.c:885:class_export_put()) final put ffff9c9b8f7a2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788752995.230585:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b8f7a2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788752995.230591:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788752995.230643:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9ba0056800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788752995.247310:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788752995.251168:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788752995.251182:0:13052:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788752995.251187:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9b90a5e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788752995.251191:0:13052:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b90a5e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788752995.251458:0:13052:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788752995.251581:0:13052:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c9b90a5c000 00000020:01000000:0.0:1788752995.251600:0:13052:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788752995.251604:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788752995.251609:0:13052:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788752995.251613:0:13052:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9c9ba00619c0) has no exports 00000100:00100000:2.0:1788752995.254732:0:5832:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9c9b87341800:5832] 0 exiting: rc = 1 00000100:00100000:3.0:1788752995.254774:0:5834:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9c9b87341000:5834] 1 exiting: rc = 0 00000100:00100000:3.0:1788752995.255646:0:5835:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9c9b91523000:5835] 2 exiting: rc = 0 00000100:00100000:1.0:1788752995.257628:0:7899:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9c9bbddb0600:7899] 3 exiting: rc = 0 00000100:00100000:3.0:1788752995.257903:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257911:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257922:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257939:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257944:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257950:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257956:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257962:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257967:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257975:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257984:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257993:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.257998:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258003:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258008:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258013:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258027:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258032:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258036:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258042:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258049:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258054:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258059:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258064:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258069:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258074:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258079:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258083:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258088:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258092:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258097:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258102:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258106:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258110:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258115:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258120:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258142:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258146:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258156:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258161:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258166:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258170:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258175:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258180:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258185:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258190:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258195:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258199:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258207:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258213:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258218:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258223:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258228:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258233:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258238:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258242:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258246:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258251:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258256:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258261:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258265:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258275:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258280:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.258286:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788752995.261894:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c9b87363a00:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1788752995.262351:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c9b87362c00:5836] 0 exiting: rc = 1 00000100:00100000:3.0:1788752995.262471:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262484:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262490:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262496:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262502:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262508:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262517:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262524:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262529:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262547:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262553:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262559:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262565:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262570:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262576:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262581:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262586:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262592:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262598:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262603:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262608:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262613:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262619:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262624:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262629:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262633:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262638:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262642:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262647:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262653:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262658:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262663:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262668:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262673:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262678:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262683:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262689:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262694:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262700:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262705:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262710:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262714:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262719:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262724:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262735:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262739:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262744:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262749:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262753:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262758:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262762:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262766:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262770:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262774:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262779:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262783:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262787:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262791:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262795:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262799:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262804:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262808:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262813:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.262817:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.263756:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9c9b87362e00:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1788752995.263851:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9c9ba078ec00:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1788752995.263971:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.263978:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.263984:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.263990:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264004:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264011:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264082:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264090:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264096:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264101:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264108:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264113:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264217:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264223:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264228:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264234:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264253:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264259:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264264:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264271:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264276:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264282:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264287:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264293:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264299:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264306:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264311:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264318:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264324:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264343:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264350:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264355:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264362:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264368:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264374:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264380:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264397:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264404:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264412:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264418:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264425:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264448:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264456:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264461:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264468:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264474:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264480:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264492:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264498:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264504:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264510:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264515:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264520:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264540:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264546:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264553:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264559:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264566:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264572:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264577:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264583:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264589:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264595:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.264600:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.274734:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c9ba078f200:5840] 0 exiting: rc = 1 00000100:00100000:3.0:1788752995.274855:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c9ba078ea00:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1788752995.274972:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.274979:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.274985:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.274990:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.274995:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275002:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275007:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275013:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275087:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275095:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275100:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275106:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275111:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275116:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275259:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275267:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275272:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275277:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275282:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275287:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275292:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275297:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275303:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275322:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275327:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275332:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275337:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275342:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275347:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275352:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275358:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275362:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275366:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275371:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275376:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275381:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275395:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275399:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275404:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275408:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275413:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275417:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275422:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275427:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275432:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275436:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275441:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275446:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275451:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275456:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275460:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275465:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275470:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275474:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275480:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275484:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275490:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275495:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275507:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275513:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275518:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275522:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275527:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.275531:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.275935:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c9ba078f000:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788752995.276220:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c9ba078fe00:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1788752995.276312:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276319:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276324:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276330:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276335:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276341:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276347:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276352:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276357:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276362:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276367:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276372:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276377:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276393:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276399:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276404:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276409:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276414:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276419:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276424:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276429:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276434:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276439:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276443:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276448:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276452:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276457:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276462:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276466:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276482:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276487:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276491:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276497:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276502:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276507:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276512:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276518:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276523:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276528:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276532:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276537:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276542:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276547:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276552:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276557:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276562:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276567:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276572:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276577:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276581:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276586:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276590:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276596:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276600:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276606:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276611:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276616:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276621:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276626:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276631:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276636:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276640:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276644:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.276649:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788752995.277190:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c9ba078f600:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1788752995.277313:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c9ba0538600:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1788752995.277422:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277428:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277434:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277439:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277444:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277449:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277455:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277460:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277465:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277472:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277478:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277484:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277490:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277495:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277501:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277506:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277511:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277516:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277521:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277526:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277531:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277536:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277542:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277547:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277552:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277557:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277562:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277567:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277572:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277577:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277582:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277587:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277592:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277597:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277602:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277617:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277623:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277629:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277634:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277639:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277645:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277650:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277655:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277660:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277665:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277670:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277675:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277681:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277686:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277691:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277696:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277702:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277707:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277712:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277717:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277723:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277728:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277733:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277739:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277744:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277748:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277753:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277759:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.277765:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788752995.278476:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9c9b8f8f0600:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1788752995.278660:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9c9b8fa68800:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1788752995.278849:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9c9b8fa69e00:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1788752995.278957:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.278966:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.278973:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.278978:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.278985:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279007:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279015:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279083:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279089:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279095:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279101:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279106:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279112:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279117:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279295:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279303:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279309:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279315:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279321:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279327:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279334:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279340:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279346:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279352:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279358:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279363:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279369:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279375:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279381:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279409:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279416:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279421:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279426:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279431:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279436:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279442:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279447:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279453:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279459:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279464:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279474:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279479:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279484:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279489:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279494:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279499:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279504:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279509:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279514:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279519:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279523:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279529:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279534:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279552:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279559:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279564:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279569:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279574:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279580:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279585:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279591:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279597:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279604:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788752995.279609:0:13052:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788752995.283861:0:13052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788752995.283876:0:13052:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788752995.283882:0:13052:0:(genops.c:885:class_export_put()) final put ffff9c9b87337000/MDS_uuid 00000020:00000080:1.0:1788752995.283887:0:13052:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b87337000/MDS_uuid for MDS 00000020:01000000:1.0:1788752995.283895:0:13052:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788752995.284006:0:13052:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788752995.501048:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182692736:0@lo:400:kworker.0 00000100:00100000:3.0:1788752995.501065:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182692608:0@lo:400:kworker.0 00000400:00000100:1.0:1788752995.504015:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875643182692736 offset 0 length 224: 4 00000100:00100000:1.0:1788752995.504107:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182692864:0@lo:400:kworker.0 00000400:00000100:1.0:1788752995.504171:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875643182692864 offset 0 length 224: 4 00000400:00000100:3.0:1788752995.505485:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875643182692608 offset 0 length 224: 4 00000001:00100000:1.0:1788752995.554150:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788752995.554160:0:7625:0:(genops.c:885:class_export_put()) final put ffff9c9b88ac6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788752995.554418:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88ac6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788752995.554473:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b88ac4000 for lustre-OST0001 00010000:00010000:1.0:1788752996.267735:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752997.292277:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788752997.813337:0:13209:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1788752997.825279:0:13209:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788752997.825336:0:13209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752997.825352:0:13209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752997.825390:0:13209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752997.825396:0:13209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788752997.825415:0:13209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788752997.825421:0:13209:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788752997.825447:0:13209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788752997.825460:0:13209:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9a85e6c380 x1875643182692736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752997.825481:0:13209:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788752997.825487:0:13209:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788752997.825512:0:13209:0:(import.c:65:import_set_state_nolock()) ffff9c9a849f1000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788752997.825635:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3304:1875643182692736:0@lo:400:kworker.0 00010000:00010000:1.0:1788752997.825779:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788752997.825787:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752997.825794:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2dc00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788752997.825797:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752997.825806:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788752997.825814:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788752997.825820:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788752997.825822:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788752997.825824:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788752997.825849:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752997.825855:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788752997.825904:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182693120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788752997.825972:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788752997.826053:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182693120 00000100:00100000:3.0:1788752997.826059:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182693120 00000100:00100000:3.0:1788752997.826098:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788752997.826105:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875643182693120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788752997.826135:0:5820:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788752997 with bad export cookie 9279728876643744419 00010000:00010000:1.0:1788752997.829691:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752997.829708:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2dc00/0x80c8383f4848fdc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x80c8383f4848fdcf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788752997.829741:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752997.829743:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752997.829746:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788752997.830222:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875643182692992:0@lo:39:umount.0 00000400:00000100:0.0:1788752997.830281:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875643182692992 offset 0 length 224: 4 00000100:00100000:3.0:1788752997.833374:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3306:x1875643182693120:12345-0@lo:103:ldlm_bl.0 Request processed in 7250us (7384us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788752997.833388:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788752997.833492:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.105@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788752997.833498:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9c9b909ff800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788752997.833502:0:3306:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788752997.840232:0:3306:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.105@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788752997.840239:0:3306:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788752997.840252:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9a85e6ea00 x1875643182692608/t0(0) o400->MGC192.168.203.105@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788753011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788752997.840339:0:3306:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9a85e01880 x1875643182693120/t0(0) o103->MGC192.168.203.105@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788753013 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788752997.840349:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788752997.840381:0:3306:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788752997.840383:0:3306:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788752997.840387:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9c9b909ff800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788752997.840392:0:3306:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 190 00000100:00080000:2.0:1788752997.840408:0:3306:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import ffff9c9b909ff800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1788752997.840443:0:3306:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bbde9fb80 x1875643182693248/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788752997.840489:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b577cb32-91f9-472d-9b00-c1edbc016b63:3306:1875643182693120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788752997.840582:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b577cb32-91f9-472d-9b00-c1edbc016b63:3302:1875643182693248:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788752997.840636:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875643182693248 offset 0 length 520: 4 00000100:00100000:0.0:1788752997.840717:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b577cb32-91f9-472d-9b00-c1edbc016b63:3303:1875643182692608:0@lo:400:kworker.0 00010000:00010000:2.0:1788752998.314410:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788752999.338281:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753000.362288:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788753000.618570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788753000.618583:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788753000.620046:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788753000.620072:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182693376:0@lo:400:kworker.0 00000400:00000100:3.0:1788753000.620163:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875643182693376 offset 0 length 224: 4 00010000:00010000:2.0:1788753001.387330:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753002.410281:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788753002.666359:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788753002.666368:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788753002.666429:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788753002.666459:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182693504:0@lo:400:kworker.0 00000400:00000100:1.0:1788753002.666508:0:3303:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875643182693504 offset 0 length 224: 4 00010000:00010000:1.0:1788753003.434896:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753004.458463:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753005.482271:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753006.506270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788753007.274234:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788752997/real 1788752997] req@ffff9c9bbde9fb80 x1875643182693248/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788753007 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788753007.274266:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c9bbde9fb80 x1875643182693248/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788753007 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788753007.274277:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788752997/real 1788752997] req@ffff9c9bbde9d180 x1875643182692992/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788753007 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788753007.274290:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c9bbde9d180 x1875643182692992/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788753007 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788753007.274318:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b909ff800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788753007.274337:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788753007.274341:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b577cb32-91f9-472d-9b00-c1edbc016b63:3302:1875643182693248:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788753007.274348:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9a849f1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788753007.274363:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875643182692992:0@lo:39:umount.0 00000100:00080000:2.0:1788753007.274399:0:13209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788753007.274405:0:13209:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788753007.274411:0:13209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788753007.274517:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788753007.274523:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788753007.274526:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c9b909ff800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788753007.274541:0:8:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 397 00000100:00080000:0.0:1788753007.274547:0:8:0:(import.c:630:import_select_connection()) MGC192.168.203.105@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788753007.274557:0:8:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import ffff9c9b909ff800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1788753007.274602:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9a85e6ea00 x1875643182693632/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788753007.274673:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788753007.274686:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182693760:0@lo:400:kworker.0 00000400:00000100:0.0:1788753007.274728:0:3306:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875643182693760 offset 0 length 224: 4 00000100:00100000:3.0:1788753007.275372:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b577cb32-91f9-472d-9b00-c1edbc016b63:3302:1875643182693632:0@lo:250:kworker.0 00000400:00000100:3.0:1788753007.275408:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875643182693632 offset 0 length 520: 4 00010000:00010000:2.0:1788753007.276619:0:13209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.276636:0:13209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.276643:0:13209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.276650:0:13209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.277989:0:13209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788753007.278015:0:13209:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.278024:0:13209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.278030:0:13209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.278036:0:13209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753007.278060:0:13209:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788753007.278065:0:13209:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788753007.278093:0:13209:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788753007.278100:0:13209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788753007.278106:0:13209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788753007.278111:0:13209:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788753007.278115:0:13209:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c9bbe5619c0) has no exports 00010000:00010000:3.0:1788753007.278162:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788753007.278173:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788753007.278173:0:13209:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9c9bbe5619c0) has no exports 00010000:00010000:3.0:1788753007.278185:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8800 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788753007.278189:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753007.278198:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788753007.278207:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753007.278213:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788753007.278215:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788753007.278218:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788753007.278233:0:6704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c9b909ff800 00010000:00010000:3.0:1788753007.278238:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753007.278244:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc8800/0x80c8383f4848fdd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fddd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753007.278258:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753007.278262:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753007.278268:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b85928600 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788753007.278278:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753007.278285:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788753007.278292:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753007.278298:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788753007.278301:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788753007.278313:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788753007.278319:0:6704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c9b909ff800 00010000:00010000:3.0:1788753007.278323:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753007.278329:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b85928600/0x80c8383f4848ffff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f48490006 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753007.278338:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753007.278339:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753007.278341:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753007.278499:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788753007.282161:0:13209:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9b87379ae0 - data ffff9c9babf6de58/ffff9c9bbde18800 00000020:01000000:2.0:1788753007.282376:0:13209:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9b94e812a0 - data ffff9c9babf55438/ffff9c9a8414a400 00100000:10000000:2.0:1788753007.291300:0:13209:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788753007.355867:0:13209:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fbd7 00000020:00000080:3.0:1788753007.355877:0:13209:0:(genops.c:885:class_export_put()) final put ffff9c9a8433e800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788753007.356243:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a8433e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1788753007.356339:0:13209:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9bbd907800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788753007.356344:0:13209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bbd907800 2 00000020:01000004:3.0:1788753007.356347:0:13209:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c9bbd907800 from lustre-OST0000 00000020:00000080:3.0:1788753007.356372:0:13209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788753007.356382:0:13209:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788753007.356386:0:13209:0:(genops.c:885:class_export_put()) final put ffff9c9a8433a800/lustre-OST0000_UUID 00000020:00000080:3.0:1788753007.356388:0:13209:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a8433a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788753007.356397:0:13209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788753007.356585:0:13209:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788753007.356590:0:13209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788753007.356594:0:13209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788753007.356600:0:13209:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788753007.356606:0:13209:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c9a849f6000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788753007.356613:0:13209:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9c9a849eb380) has exports, disconnecting them 00000020:00080000:3.0:1788753007.356618:0:13209:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c9a849f6000), last request at 1788752806 00000020:00000080:3.0:1788753007.356622:0:13209:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fc01 00000020:00080000:3.0:1788753007.356633:0:13209:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c9a849f6000): rc 0 00000020:00000080:3.0:1788753007.356683:0:13209:0:(genops.c:885:class_export_put()) final put ffff9c9a849f6000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788753007.359241:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a849f6000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788753007.360979:0:13209:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788753007.360991:0:13209:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788753007.361228:0:13209:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788753007.361236:0:13209:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788753007.361401:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9a849f1000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788753007.361566:0:13209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788753007.361580:0:13209:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788753007.361612:0:13209:0:(genops.c:885:class_export_put()) final put ffff9c9a8433d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788753007.361617:0:13209:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a8433d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788753007.361626:0:13209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788753007.361685:0:13209:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bbd907800 1 00000020:00000080:0.0:1788753007.361691:0:13209:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fb91 00000020:00000080:0.0:1788753007.361698:0:13209:0:(genops.c:885:class_export_put()) final put ffff9c9bae097000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788753007.361704:0:13209:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788753007.361708:0:13209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788753007.361712:0:13209:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788753007.361716:0:13209:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9c9b8731cd40) has no exports 00000020:00000080:1.0:1788753007.361960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bae097000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788753007.386177:0:13209:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788753007.386194:0:13209:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788753007.386200:0:13209:0:(genops.c:885:class_export_put()) final put ffff9c9bae093800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788753007.386205:0:13209:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bae093800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788753007.386215:0:13209:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788753007.386378:0:13209:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c9bbd904800 00000020:02000400:2.0:1788753007.386423:0:13209:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788753007.530452:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753008.554385:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753009.578455:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788753009.908650:0:13363:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788753009.938305:0:13363:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788753009.938391:0:13363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753009.938406:0:13363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753009.938428:0:13363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753009.938435:0:13363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753009.938457:0:13363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788753009.938462:0:13363:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788753009.938489:0:13363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788753009.938502:0:13363:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9a85e6e680 x1875643182692864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753011 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753009.938523:0:13363:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9bbde9e300 x1875643182693376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753016 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753009.938544:0:13363:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9a85e01500 x1875643182693504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753009.938558:0:13363:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9a85e6d880 x1875643182693760/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753023 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753009.938572:0:13363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788753009.938606:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3303:1875643182693504:0@lo:400:kworker.0 00000100:00100000:0.0:1788753009.938639:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182693760:0@lo:400:kworker.0 00000100:00080000:0.0:1788753009.938653:0:13363:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788753009.938676:0:13363:0:(import.c:65:import_set_state_nolock()) ffff9c9bafe43000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788753009.938783:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182692864:0@lo:400:kworker.0 00010000:00010000:3.0:1788753009.938845:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753009.938853:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753009.938861:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2da00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788753009.938865:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753009.938874:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788753009.938881:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753009.938887:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788753009.938890:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788753009.938892:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788753009.938904:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c9b909ff800 00010000:00010000:3.0:1788753009.938907:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753009.938920:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2da00/0x80c8383f4848fdac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fdb3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753009.938930:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753009.938932:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753009.938933:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788753009.938948:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875643182693888:0@lo:39:umount.0 00000400:00000100:3.0:1788753009.938995:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875643182693888 offset 0 length 224: 4 00000100:00100000:1.0:1788753009.943899:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182693376:0@lo:400:kworker.0 00010000:00010000:2.0:1788753010.604812:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753011.626292:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788753012.394475:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788753012.394486:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788753012.650427:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753013.675209:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753014.698854:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753015.722940:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753016.746382:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788753017.514252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788753017.514263:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) b577cb32-91f9-472d-9b00-c1edbc016b63->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788753017.770281:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753018.794364:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788753019.114267:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788753009/real 1788753009] req@ffff9c9a85e6d880 x1875643182693888/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788753019 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788753019.114298:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c9a85e6d880 x1875643182693888/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788753019 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788753019.114316:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bafe43000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788753019.114338:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875643182693888:0@lo:39:umount.0 00000100:00080000:0.0:1788753019.114515:0:13363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788753019.114520:0:13363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788753019.114526:0:13363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788753019.116315:0:13363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116332:0:13363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116340:0:13363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116346:0:13363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116378:0:13363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753019.116385:0:13363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116392:0:13363:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116397:0:13363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116403:0:13363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753019.116425:0:13363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788753019.116430:0:13363:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:2.0:1788753019.116478:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788753019.116486:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.116495:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2d400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788753019.116498:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.116507:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788753019.116515:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788753019.116521:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788753019.116523:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788753019.116525:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788753019.116540:0:6704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c9b909ff800 00010000:00010000:2.0:1788753019.116544:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.116551:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2d400/0x80c8383f4848fdba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fdc1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.116564:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788753019.116568:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.116584:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9ba3b2c200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:2.0:1788753019.116586:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.116593:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788753019.116599:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788753019.116604:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788753019.116606:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788753019.116609:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788753019.116618:0:6704:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c9b909ff800 00010000:00010000:2.0:1788753019.116621:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.116627:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9ba3b2c200/0x80c8383f4848fff1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fff8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753019.116634:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753019.116642:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753019.116645:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753019.116648:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788753019.117533:0:13363:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788753019.117537:0:13363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788753019.117543:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788753019.117550:0:13363:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788753019.117562:0:13363:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c9a841619c0) has no exports 00000020:00080000:0.0:1788753019.117585:0:13363:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9c9a841619c0) has no exports 00000020:01000000:0.0:1788753019.121035:0:13363:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9bb5ad7ae0 - data ffff9c9bbf0f3bd0/ffff9c9a8579e000 00000020:01000000:0.0:1788753019.121211:0:13363:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c9b873799c0 - data ffff9c9b90f20948/ffff9c9a85386800 00100000:10000000:0.0:1788753019.129866:0:13363:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788753019.150725:0:13363:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fca2 00000020:00000080:2.0:1788753019.150735:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9a8429b000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788753019.150757:0:13363:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9bafe44000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788753019.150761:0:13363:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bafe44000 2 00000020:01000004:2.0:1788753019.150764:0:13363:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c9bafe44000 from lustre-OST0001 00000020:00000080:2.0:1788753019.150786:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788753019.150806:0:13363:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788753019.150810:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9a85148800/lustre-OST0001_UUID 00000020:00000080:2.0:1788753019.150813:0:13363:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a85148800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788753019.150820:0:13363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788753019.151001:0:13363:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import b577cb32-91f9-472d-9b00-c1edbc016b63->MGS 00010000:00010000:2.0:1788753019.151017:0:13363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fbbb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788753019.151028:0:13363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fbbb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788753019.151034:0:13363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788753019.151037:0:13363:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788753019.151040:0:13363:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788753019.151053:0:13363:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c9b909ff800 00010000:00010000:2.0:1788753019.151056:0:13363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b85928c00/0x80c8383f4848fbb4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fbbb expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753019.151069:0:13363:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x80c8383f4848fe07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788753019.151075:0:13363:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x80c8383f4848fe07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788753019.151079:0:13363:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788753019.151081:0:13363:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788753019.151083:0:13363:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788753019.151092:0:13363:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c9b909ff800 00010000:00010000:2.0:1788753019.151095:0:13363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9400/0x80c8383f4848fe00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x80c8383f4848fe07 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788753019.151111:0:13363:0:(import.c:65:import_set_state_nolock()) ffff9c9b909ff800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788753019.151150:0:13363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788753019.151153:0:13363:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788753019.151155:0:13363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788753019.151160:0:13363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788753019.151171:0:13363:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c9a85e6ea00 x1875643182693632/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788753022 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788753019.151316:0:13363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788753019.151320:0:13363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000020:00000080:3.0:1788753019.151379:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a8429b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788753019.151464:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b577cb32-91f9-472d-9b00-c1edbc016b63:3302:1875643182693632:0@lo:250:kworker.0 10000000:01000000:2.0:1788753019.151616:0:13363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788753019.151623:0:13363:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fa95 00000020:00000080:2.0:1788753019.151628:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9b87331000/b577cb32-91f9-472d-9b00-c1edbc016b63 00000020:01000000:2.0:1788753019.151642:0:13363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.105@tcp (flags='') 00000020:00000080:2.0:1788753019.151648:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788753019.151654:0:13363:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.105@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788753019.151658:0:13363:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9c9b8731b380) has no exports 00000020:00000080:3.0:1788753019.151710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b87331000/b577cb32-91f9-472d-9b00-c1edbc016b63 for MGC192.168.203.105@tcp 10000000:01000000:1.0:1788753019.151760:0:5829:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788753019.151832:0:13363:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.105@tcp: client import never connected 00000100:00080000:2.0:1788753019.151835:0:13363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788753019.151837:0:13363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788753019.151839:0:13363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788753019.151840:0:13363:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788753019.151966:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788753019.151972:0:13363:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.105@tcp (uuid b577cb32-91f9-472d-9b00-c1edbc016b63) 00000020:01000000:2.0:1788753019.151977:0:13363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788753019.151980:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788753019.151983:0:13363:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788753019.151987:0:13363:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c9a842b4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788753019.151992:0:13363:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9c9b88b44d40) has exports, disconnecting them 00000020:00080000:2.0:1788753019.151996:0:13363:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c9a842b4000), last request at 1788752822 00000020:00000080:2.0:1788753019.152000:0:13363:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fccc 00000020:00080000:2.0:1788753019.152010:0:13363:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c9a842b4000): rc 0 00000020:00000080:2.0:1788753019.152014:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9a842b4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788753019.152313:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9b909ff800 for MGC192.168.203.105@tcp 00000020:00000080:3.0:1788753019.152320:0:8:0:(genops.c:885:class_export_put()) final put ffff9c9b909fb000/b577cb32-91f9-472d-9b00-c1edbc016b63 00000020:00000080:3.0:1788753019.152323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b909fb000/b577cb32-91f9-472d-9b00-c1edbc016b63 for MGC192.168.203.105@tcp 00000020:01000000:3.0:1788753019.152327:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.105@tcp (b577cb32-91f9-472d-9b00-c1edbc016b63) 00000020:00000080:3.0:1788753019.152935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a842b4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788753019.155768:0:13363:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788753019.155776:0:13363:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788753019.155780:0:13363:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788753019.155788:0:13363:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788753019.155846:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788753019.156800:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1788753019.156901:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9c9bafe43000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788753019.157029:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788753019.157243:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c9b91437000:5816] 0 exiting: rc = 1 00000100:00100000:1.0:1788753019.157294:0:7615:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9c9a85755a00:7615] 2 exiting: rc = 0 00000100:00100000:3.0:1788753019.158187:0:5817:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c9b9b449600:5817] 1 exiting: rc = 0 00000100:00100000:1.0:1788753019.158408:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.158663:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c9b91436800:5818] 0 exiting: rc = 1 00000100:00100000:3.0:1788753019.158721:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c9b91437600:5820] 2 exiting: rc = 0 00000100:00100000:3.0:1788753019.159252:0:11152:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c9a8412f400:11152] 3 exiting: rc = 0 00000100:00100000:3.0:1788753019.161255:0:5819:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c9b91436c00:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1788753019.161386:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161396:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161402:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161407:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161413:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161418:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161425:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161430:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161435:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161440:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161446:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161451:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161457:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161463:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161469:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161476:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161483:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161488:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161503:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161510:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161515:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161520:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161525:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161530:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161536:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161541:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161546:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161552:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161556:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161573:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161578:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161582:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161587:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161591:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161596:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161601:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161605:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161610:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161615:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161621:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161625:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161630:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161636:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161641:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161646:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161651:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161656:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161661:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161666:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161672:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161676:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161681:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161686:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161690:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161694:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161699:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161704:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161709:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161713:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161718:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161723:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161729:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161733:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.161737:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788753019.162671:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788753019.162680:0:13363:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788753019.162685:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9a842b4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788753019.162688:0:13363:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9a842b4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788753019.162694:0:13363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788753019.162733:0:13363:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bafe44000 1 00000020:00000080:1.0:1788753019.162738:0:13363:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x80c8383f4848fc71 00000020:00000080:1.0:1788753019.162745:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9b88ac3800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788753019.162762:0:13363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788753019.162766:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788753019.162769:0:13363:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788753019.162772:0:13363:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9c9b88b43380) has no exports 00000020:00000080:3.0:1788753019.162836:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9b88ac3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788753019.172760:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788753019.172775:0:13363:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788753019.172780:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9bafe44800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788753019.172785:0:13363:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bafe44800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788753019.172793:0:13363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788753019.172988:0:13363:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c9bafe47000 00000020:01000000:3.0:1788753019.173012:0:13363:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788753019.173016:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788753019.173021:0:13363:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788753019.173025:0:13363:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9c9b87318000) has no exports 00000020:00000080:3.0:1788753019.173050:0:13363:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788753019.173056:0:13363:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788753019.173059:0:13363:0:(genops.c:885:class_export_put()) final put ffff9c9bae091000/OSS_uuid 00000020:00000080:3.0:1788753019.173070:0:13363:0:(genops.c:844:class_export_destroy()) destroying export ffff9c9bae091000/OSS_uuid for OSS 00000020:01000000:3.0:1788753019.173074:0:13363:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788753019.173102:0:5828:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788753019.173285:0:9256:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9c9a810fe200:9256] 3 exiting: rc = 0 00000100:00100000:3.0:1788753019.174268:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9c9b90981800:6688] 0 exiting: rc = 1 00000100:00100000:3.0:1788753019.174333:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9c9b90981a00:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1788753019.174380:0:12054:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff9c9b98b37800:12054] 4 exiting: rc = 0 00000100:00100000:3.0:1788753019.174433:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9c9bb5302800:6691] 2 exiting: rc = 0 00000100:00100000:3.0:1788753019.174484:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174492:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174498:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174506:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174511:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174516:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174521:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174526:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174532:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174536:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174542:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174547:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174551:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174557:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174562:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174567:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174572:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174577:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174582:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174587:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174592:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174598:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174603:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174609:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174614:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174619:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174636:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174641:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174653:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174661:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174666:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174671:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174675:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174680:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174685:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174690:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174694:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174699:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174704:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174709:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174715:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174720:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174725:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174730:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174736:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174741:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174745:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174750:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174754:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174759:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174765:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174770:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174775:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174781:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174786:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174791:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174796:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174801:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174807:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174812:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174817:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174828:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174833:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.174838:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.177546:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c9baec14400:6692] 0 exiting: rc = 1 00000100:00100000:3.0:1788753019.177694:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c9baec15400:6693] 1 exiting: rc = 0 00000100:00100000:0.0:1788753019.178015:0:9196:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c9b88be7600:9196] 2 exiting: rc = 0 00000100:00100000:3.0:1788753019.178241:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178249:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178254:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178260:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178265:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178271:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178275:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178280:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178286:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178290:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178295:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178300:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178305:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178310:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178315:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178320:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178326:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178332:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178337:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178342:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178348:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178353:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178358:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178363:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178368:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178373:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178377:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178382:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178387:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178393:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178398:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178416:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178423:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178428:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178434:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178439:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178445:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178451:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178457:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178462:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178467:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178473:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178479:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178484:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178489:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178495:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178499:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178504:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178511:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178517:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178524:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178529:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178534:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178543:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178548:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178554:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178559:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178565:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178570:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178575:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178581:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178587:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178592:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.178597:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.179528:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c9bb5303c00:6696] 2 exiting: rc = 0 00000100:00100000:1.0:1788753019.179788:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c9baec14600:6694] 0 exiting: rc = 1 00000100:00100000:0.0:1788753019.180411:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c9bb5303e00:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1788753019.180691:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180708:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180713:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180719:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180725:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180731:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180737:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180742:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180756:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180762:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180767:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180772:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180777:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180782:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180787:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180792:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180798:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180803:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180807:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180812:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180817:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180822:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180828:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180834:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180839:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180844:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180850:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180923:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180931:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180936:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180941:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180947:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180966:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180974:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180979:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180985:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.180997:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181002:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181007:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181013:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181019:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181024:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181029:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181034:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181039:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181044:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181048:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181053:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181059:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181063:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181068:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181073:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181078:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181084:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181089:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181095:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181100:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181106:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181244:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181254:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181259:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181265:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181271:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.181277:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788753019.189177:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c9baec15600:6697] 0 exiting: rc = 1 00000100:00100000:1.0:1788753019.189273:0:6884:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff9c9a8498c800:6884] 2 exiting: rc = 0 00000100:00100000:3.0:1788753019.189430:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c9baec15a00:6698] 1 exiting: rc = 0 00000100:00100000:3.0:1788753019.189485:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189492:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189498:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189504:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189510:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189515:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189532:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189537:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189543:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189548:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189553:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189558:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189564:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189569:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189574:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189579:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189584:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189591:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189596:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189601:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189606:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189611:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189617:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189622:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189626:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189632:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189637:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189641:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189646:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189652:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189657:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189662:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189667:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189672:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189678:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189683:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189688:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189692:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189697:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189702:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189706:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189718:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189723:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189730:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189736:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189742:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189746:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189751:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189756:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189761:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189766:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189771:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189776:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189781:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189786:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189790:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189796:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189802:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189808:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189814:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189820:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189825:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189829:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.189841:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.190643:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c9a810ff600:6700] 1 exiting: rc = 0 00000100:00100000:1.0:1788753019.190910:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c9ba18d2200:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1788753019.191059:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191066:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191079:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191087:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191094:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191101:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191108:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191145:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191152:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191158:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191165:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191190:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191198:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191205:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191211:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191217:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191234:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191241:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191246:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191252:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191257:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191262:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191267:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191287:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191296:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191302:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191307:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191313:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191323:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191329:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191335:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191341:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191347:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191353:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191358:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191379:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191385:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191391:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191398:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191406:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191412:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191418:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191424:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191429:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191436:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191441:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191456:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191475:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191482:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191487:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191493:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191501:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191507:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191513:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191520:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191525:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191531:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191537:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191543:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191563:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191570:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191577:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191582:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788753019.191590:0:13363:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788753019.202515:0:13363:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788753031.548490:0:13976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788753037.879773:0:14437:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788753037.879779:0:14437:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788753037.879900:0:14437:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c9bbdf68000 00000020:01000004:2.0:1788753037.879915:0:14437:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788753037.879924:0:14437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788753037.879938:0:14437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c9ba00619c0) 00000020:00000080:2.0:1788753037.879951:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788753037.894445:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788753037.896244:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788753037.896656:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788753037.896721:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:2.0:1788753037.896806:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:2.0:1788753037.896895:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:2.0:1788753037.896984:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:2.0:1788753037.897070:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:2.0:1788753037.897593:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:2.0:1788753037.897844:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:2.0:1788753037.899248:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 438: rc = 0 00100000:10000000:2.0:1788753037.899355:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 438: rc = 0 00100000:10000000:2.0:1788753037.899892:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 555: rc = 0 00100000:10000000:2.0:1788753037.900192:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 555: rc = 0 00100000:10000000:2.0:1788753037.900607:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 555: rc = 0 00100000:10000000:2.0:1788753037.900827:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 555: rc = 0 00100000:10000000:2.0:1788753037.901040:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 555: rc = 0 00100000:10000000:2.0:1788753037.901518:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 555: rc = 0 00100000:10000000:2.0:1788753037.901781:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 555: rc = 0 00100000:10000000:2.0:1788753037.902029:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 555: rc = 0 00100000:10000000:2.0:1788753037.902331:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 555: rc = 0 00100000:10000000:2.0:1788753037.902586:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 555: rc = 0 00100000:10000000:2.0:1788753037.902856:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 555: rc = 0 00100000:10000000:2.0:1788753037.903077:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 555: rc = 0 00100000:10000000:2.0:1788753037.903555:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 570: rc = 0 00100000:10000000:2.0:1788753037.903776:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 570: rc = 0 00100000:10000000:2.0:1788753037.903989:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 570: rc = 0 00100000:10000000:2.0:1788753037.904249:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 570: rc = 0 00100000:10000000:2.0:1788753037.904468:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 570: rc = 0 00100000:10000000:2.0:1788753037.904691:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 570: rc = 0 00100000:10000000:2.0:1788753037.904900:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 570: rc = 0 00100000:10000000:2.0:1788753037.905299:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 570: rc = 0 00100000:10000000:2.0:1788753037.905523:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 570: rc = 0 00100000:10000000:2.0:1788753037.905744:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 570: rc = 0 00100000:10000000:2.0:1788753037.905960:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 570: rc = 0 00100000:10000000:2.0:1788753037.906499:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 570: rc = 0 00100000:10000000:2.0:1788753037.906750:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 570: rc = 0 00100000:10000000:2.0:1788753037.907002:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 570: rc = 0 00100000:10000000:2.0:1788753037.907482:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 570: rc = 0 00100000:10000000:2.0:1788753037.907707:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 570: rc = 0 00100000:10000000:2.0:1788753037.907930:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 570: rc = 0 00100000:10000000:2.0:1788753037.908276:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 570: rc = 0 00100000:10000000:2.0:1788753037.908568:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 570: rc = 0 00100000:10000000:2.0:1788753037.908785:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 570: rc = 0 00100000:10000000:2.0:1788753037.909013:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 570: rc = 0 00100000:10000000:2.0:1788753037.909590:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 570: rc = 0 00100000:10000000:2.0:1788753037.909840:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 570: rc = 0 00100000:10000000:2.0:1788753037.910087:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 570: rc = 0 00100000:10000000:2.0:1788753037.910682:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 570: rc = 0 00100000:10000000:2.0:1788753037.910980:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 570: rc = 0 00100000:10000000:2.0:1788753037.911277:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 570: rc = 0 00100000:10000000:2.0:1788753037.911549:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 570: rc = 0 00100000:10000000:2.0:1788753037.911786:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 570: rc = 0 00100000:10000000:2.0:1788753037.912087:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 570: rc = 0 00100000:10000000:2.0:1788753037.912397:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 570: rc = 0 00100000:10000000:2.0:1788753037.912637:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 570: rc = 0 00100000:10000000:2.0:1788753037.912996:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 561: rc = 0 00100000:10000000:3.0:1788753037.914879:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788753037.915052:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 439: rc = 0 00100000:10000000:3.0:1788753037.915494:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788753037.915565:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 439: rc = 0 00100000:10000000:3.0:1788753037.915737:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788753037.915801:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 439: rc = 0 00100000:10000000:3.0:1788753037.916319:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788753037.916395:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:3.0:1788753037.916585:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788753037.916656:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:3.0:1788753037.916852:0:14437:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788753037.916919:0:14437:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 768: rc = 0 00000020:00000080:3.0:1788753037.917372:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788753037.917388:0:14437:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788753037.917397:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f48490d88 00000020:01000004:3.0:1788753037.917405:0:14437:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788753037.917409:0:14437:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788753037.917414:0:14437:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c9bbdf68000 from MGS 00000020:01000004:3.0:1788753037.917418:0:14437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788753037.917427:0:14437:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c9a849ecd40) 00000020:00000080:3.0:1788753037.917436:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788753037.917482:0:14437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bbdf68000 from MGS, refs=2 00080000:01000000:3.0:1788753037.917487:0:14437:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788753037.917492:0:14437:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f48490d96 00000100:00100000:3.0:1788753037.917587:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788753037.917719:0:14437:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788753037.917725:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788753037.918352:0:14437:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788753037.918359:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788753037.918881:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753037.919022:0:14437:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788753037.919027:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788753037.921795:0:14437:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788753037.921806:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788753037.922059:0:14437:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788753037.922064:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788753037.922716:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753037.922719:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753037.922721:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753037.922966:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753037.922968:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753037.922970:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753037.923540:0:14437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788753037.927313:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788753037.937028:0:14437:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788753037.937047:0:14437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788753037.937050:0:14437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788753037.938591:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788753037.938761:0:14437:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788753037.938858:0:14437:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788753037.939403:0:14437:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788753037.939695:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788753037.939841:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788753037.939847:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788753037.947829:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788753037.947841:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788753037.948397:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788753037.948404:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788753037.949284:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788753037.949303:0:14437:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.105@tcp' 00000020:01000004:0.0:1788753037.949305:0:14437:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788753037.949331:0:14437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.105@tcp (typ=mgc) 00000020:00000080:0.0:1788753037.949343:0:14437:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.105@tcp (ffff9c9a84163380) 00000020:00000080:0.0:1788753037.949355:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788753037.949423:0:14437:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9bb5103800@MGC192.168.203.105@tcp: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1788753037.949578:0:14437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.105@tcp-0 is initialized 00000040:01000000:0.0:1788753037.949584:0:14437:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788753037.949809:0:14451:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788753037.952925:0:14453:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788753037.953008:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.105@tcp (uuid cf43312c-18dc-4b92-a763-9e6fba828a91) 00000020:00000080:0.0:1788753037.953033:0:14437:0:(genops.c:1384:class_connect()) connect: client cf43312c-18dc-4b92-a763-9e6fba828a91, cookie 0x80c8383f48490da4 00000100:00080000:0.0:1788753037.953055:0:14437:0:(import.c:545:import_select_connection()) MGC192.168.203.105@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788753037.953068:0:14437:0:(import.c:666:import_select_connection()) MGC192.168.203.105@tcp: import ffff9c9bb5103800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1788753037.953161:0:14437:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9a85e6dc00 x1875643182694016/t0(0) o250->MGC192.168.203.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788753037.953189:0:14437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cf43312c-18dc-4b92-a763-9e6fba828a91->MGS 00000020:01000004:0.0:1788753037.953212:0:14437:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788753037.953235:0:14437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788753037.953248:0:14437:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c9a84164d40) 00000020:00000080:0.0:1788753037.953260:0:14437:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788753037.954639:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cf43312c-18dc-4b92-a763-9e6fba828a91:3302:1875643182694016:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788753037.954706:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753037.956243:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694016 00000100:00100000:0.0:1788753037.956255:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694016 00000100:00100000:0.0:1788753037.956293:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788753037.956302:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3302:x1875643182694016:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788753037.956328:0:14447:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from cf43312c-18dc-4b92-a763-9e6fba828a91@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:0.0:1788753037.956358:0:14447:0:(genops.c:1384:class_connect()) connect: client cf43312c-18dc-4b92-a763-9e6fba828a91, cookie 0x80c8383f48490db2 00000100:00080000:0.0:1788753037.956490:0:14447:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5105800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788753037.956572:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+5:3302:x1875643182694016:12345-0@lo:250:mount.lustre.0 Request processed in 268us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753037.956579:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788753037.958384:0:3302:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.105@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788753037.958398:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.105@tcp: connect to target with instance 0 00000100:00080000:3.0:1788753037.958407:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.105@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788753037.958412:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788753037.958417:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5103800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788753037.958420:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788753037.958431:0:3302:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788753037.958440:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cf43312c-18dc-4b92-a763-9e6fba828a91:3302:1875643182694016:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788753037.968964:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788753037.969220:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788753037.969227:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788753037.971088:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788753037.971109:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788753037.971663:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788753037.971669:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788753037.975839:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788753037.976016:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788753037.976022:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788753037.976580:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788753037.976587:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788753038.013676:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753038.013883:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788753038.013889:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788753038.015153:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788753038.015163:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788753038.015744:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788753038.015903:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788753038.015908:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788753038.022872:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788753038.022885:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788753038.023508:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753038.023684:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788753038.023689:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788753038.024573:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788753038.024581:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788753038.025847:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753038.026014:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788753038.026020:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788753038.026831:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788753038.026839:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788753038.042636:0:14437:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753038.042901:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788753038.042908:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788753038.044348:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788753038.044359:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788753038.045053:0:14437:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788753038.045060:0:14437:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788753038.045926:0:14437:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788753038.045946:0:14437:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788753038.045951:0:14437:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788753038.046083:0:14437:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788753038.046503:0:14437:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788753038.046508:0:14437:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788753038.046509:0:14437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788753038.046511:0:14437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788753038.046512:0:14437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788753038.046513:0:14437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788753038.046514:0:14437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788753038.046516:0:14437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788753038.046517:0:14437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788753038.046519:0:14437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788753038.046520:0:14437:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788753038.046524:0:14437:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788753038.046526:0:14437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788753038.046528:0:14437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788753038.046529:0:14437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788753038.046530:0:14437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788753038.046536:0:14437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788753038.046537:0:14437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788753038.046538:0:14437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788753038.046539:0:14437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788753038.046540:0:14437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788753038.046541:0:14437:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788753038.046567:0:14437:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788753038.046586:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694144:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788753038.046654:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.046760:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928c3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788753038.046855:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694144 00000100:00100000:0.0:1788753038.046864:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694144 00000100:00100000:0.0:1788753038.046943:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788753038.046953:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+5:14437:x1875643182694144:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788753038.046993:0:14450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788753038.046996:0:14450:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788753038.046999:0:14450:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788753038.047553:0:14472:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788753038.047944:0:14450:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788753038.049027:0:14473:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788753038.049033:0:14473:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788753038.049036:0:14473:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788753038.049077:0:14473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788753038.049695:0:14450:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788753038.049710:0:14450:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788753038.055107:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+5:14437:x1875643182694144:12345-0@lo:253:mount.lustre.0 Request processed in 8137us (8433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.055159:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788753038.055357:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694144:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788753038.055374:0:14437:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788753038.055377:0:14437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788753038.055379:0:14437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788753038.055380:0:14437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788753038.055381:0:14437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788753038.055383:0:14437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788753038.055384:0:14437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788753038.055386:0:14437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788753038.055387:0:14437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788753038.055388:0:14437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788753038.055390:0:14437:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788753038.055419:0:14437:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c9bbdf68000 from lustre-MDT0000 10000000:01000000:3.0:1788753038.055443:0:14437:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788753038.055446:0:14437:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788753038.055451:0:14437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c9a84163380 10000000:01000000:3.0:1788753038.055456:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788753038.055463:0:14437:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c9a84163380 from 1 10000000:01000000:3.0:1788753038.055466:0:14437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788753038.055501:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.055512:0:14437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.055541:0:14437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.055561:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788753038.055607:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.055643:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788753038.055713:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694272 00000100:00100000:1.0:1788753038.055720:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694272 00000100:00100000:1.0:1788753038.055759:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788753038.055769:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+5:14437:x1875643182694272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753038.055781:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753038.055795:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe271a00/0x80c8383f48490dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490db9 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.055816:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe271a00/0x80c8383f48490dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490db9 expref: 6 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.055827:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe271a00/0x80c8383f48490dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490db9 expref: 6 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.055835:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271a00, rc 0) 00000100:00100000:1.0:1788753038.055872:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+6:14437:x1875643182694272:12345-0@lo:101:mount.lustre.0 Request processed in 105us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753038.055878:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788753038.055975:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753038.055988:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.055996:0:14437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.056038:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694400:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753038.056075:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.056104:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.056176:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694400 00000100:00100000:2.0:1788753038.056181:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694400 00000100:00100000:2.0:1788753038.056214:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788753038.056221:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+6:14437:x1875643182694400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753038.056420:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+6:14437:x1875643182694400:12345-0@lo:501:mount.lustre.0 Request processed in 200us (344us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788753038.056427:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788753038.056631:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694400:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788753038.056654:0:14437:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788753038.056665:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.056674:0:14437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753038.056681:0:14437:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c9bbdf68000 10000000:01000000:3.0:1788753038.056697:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788753038.056707:0:14437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c9bbdf68000 10000000:01000000:3.0:1788753038.056710:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788753038.056712:0:14437:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c9bbdf68000 from 1 10000000:01000000:3.0:1788753038.056715:0:14437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788753038.056733:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80030600/0x80c8383f48490dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.056740:0:14437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b80030600/0x80c8383f48490dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.056747:0:14437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b80030600/0x80c8383f48490dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.056760:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788753038.056785:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.056814:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.056866:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694528 00000100:00100000:2.0:1788753038.056871:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694528 00000100:00100000:2.0:1788753038.056894:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788753038.056901:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+6:14437:x1875643182694528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788753038.056909:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753038.056920:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b0a00/0x80c8383f48490dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490dc7 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.056935:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b0a00/0x80c8383f48490dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490dc7 expref: 7 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.056943:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b0a00/0x80c8383f48490dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490dc7 expref: 7 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.056949:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0a00, rc 0) 00000100:00100000:2.0:1788753038.056985:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+7:14437:x1875643182694528:12345-0@lo:101:mount.lustre.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753038.056991:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788753038.057062:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753038.057073:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b80030600/0x80c8383f48490dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dce expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.057081:0:14437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b80030600/0x80c8383f48490dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490dce expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753038.057092:0:14437:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788753038.057111:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80030600/0x80c8383f48490dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dce expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.057118:0:14437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b80030600/0x80c8383f48490dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dce expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753038.057165:0:14437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788753038.057178:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788753038.057184:0:14437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c9bbdf68000 10000000:01000000:3.0:1788753038.057186:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788753038.057189:0:14437:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788753038.057192:0:14437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788753038.057205:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031a00/0x80c8383f48490dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.057213:0:14437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b80031a00/0x80c8383f48490dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.057221:0:14437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b80031a00/0x80c8383f48490dd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.057233:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788753038.057259:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.057283:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928c3300 going to sleep for 11 seconds 00000100:00100000:1.0:1788753038.057342:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694656 00000100:00100000:1.0:1788753038.057347:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694656 00000100:00100000:1.0:1788753038.057374:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788753038.057381:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+7:14437:x1875643182694656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753038.057388:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753038.057396:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe270e00/0x80c8383f48490ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490dd5 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.057422:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe270e00/0x80c8383f48490ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490dd5 expref: 8 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.057430:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe270e00/0x80c8383f48490ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490dd5 expref: 8 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.057437:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270e00, rc 0) 00000100:00100000:1.0:1788753038.057472:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+8:14437:x1875643182694656:12345-0@lo:101:mount.lustre.0 Request processed in 92us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753038.057478:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788753038.057548:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753038.057558:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b80031a00/0x80c8383f48490dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ddc expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.057565:0:14437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b80031a00/0x80c8383f48490dd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490ddc expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.057599:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753038.057620:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.057643:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.057707:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694784 00000100:00100000:2.0:1788753038.057711:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694784 00000100:00100000:2.0:1788753038.057731:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788753038.057743:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+8:14437:x1875643182694784:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753038.058052:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14437:x1875643182694784:12345-0@lo:501:mount.lustre.0 Request processed in 308us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753038.058058:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788753038.058202:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753038.058230:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788753038.058268:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.058285:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b928c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.058349:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182694912 00000100:00100000:2.0:1788753038.058355:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182694912 00000100:00100000:2.0:1788753038.058378:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788753038.058383:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14437:x1875643182694912:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753038.058722:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14437:x1875643182694912:12345-0@lo:503:mount.lustre.0 Request processed in 336us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753038.058729:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788753038.058855:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182694912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788753038.059375:0:14474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14474:1875643182695040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788753038.059421:0:14474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753038.059489:0:14474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b941e5180 going to sleep for 11 seconds 00000100:00100000:1.0:1788753038.059526:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182695040 00000100:00100000:1.0:1788753038.059532:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182695040 00000100:00100000:1.0:1788753038.059595:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788753038.059604:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14474:x1875643182695040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788753038.059860:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14474:x1875643182695040:12345-0@lo:502:llog_process_th.0 Request processed in 257us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753038.059866:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788753038.059945:0:14474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14474:1875643182695040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788753038.059967:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788753038.059977:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.059980:0:14474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788753038.059985:0:14474:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788753038.059988:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788753038.060000:0:14474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c9a84160000) 00000020:00000080:0.0:1788753038.060018:0:14474:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788753038.060022:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788753038.060110:0:14474:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788753038.060117:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f48490dea 00000020:00000080:0.0:1788753038.060330:0:14474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788753038.060335:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788753038.060339:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.060340:0:14474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788753038.060343:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788753038.060346:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.060348:0:14474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788753038.060351:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788753038.060358:0:14474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c9a841619c0) 00000020:00000080:0.0:1788753038.060368:0:14474:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788753038.060371:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788753038.060374:0:14474:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788753038.060377:0:14474:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788753038.060389:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788753038.060429:0:14474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bbdf68000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788753038.060442:0:14474:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c9b87318000) 00000020:00000080:0.0:1788753038.060451:0:14474:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788753038.060500:0:14474:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788753038.060507:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f48490dff 00000020:00000080:0.0:1788753038.060590:0:14474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788753038.060597:0:14474:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788753038.060602:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x80c8383f48490e06 00080000:01000000:0.0:1788753038.060606:0:14474:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788753038.060609:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f48490e0d 00010000:00010000:3.0:1788753038.109605:0:14474:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788753038.110008:0:14474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788753038.110295:0:14474:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788753038.110832:0:14474:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c9a849e8000) 00000020:00000080:3.0:1788753038.110849:0:14474:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788753038.110920:0:14474:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788753038.110927:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f48490e1b 00000020:00000080:2.0:1788753038.111427:0:14474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788753038.117160:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x80c8383f48490e22 00000020:00000080:2.0:1788753038.117929:0:14474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788753038.117940:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753038.117946:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.117949:0:14474:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788753038.117952:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788753038.117955:0:14474:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788753038.117957:0:14474:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788753038.117959:0:14474:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788753038.117960:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788753038.117962:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.117964:0:14474:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788753038.117966:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753038.117970:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.117971:0:14474:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788753038.117976:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788753038.118006:0:14474:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788753038.118021:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753038.118031:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.118033:0:14474:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788753038.118036:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788753038.118039:0:14474:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788753038.118042:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.118044:0:14474:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788753038.118047:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788753038.118052:0:14474:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000020:01000000:2.0:1788753038.118077:0:14474:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788753038.118080:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788753038.118094:0:14474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c9ba0060000) 00000020:00000080:2.0:1788753038.118119:0:14474:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788753038.118149:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788753038.118206:0:14474:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788753038.118212:0:14474:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788753038.118218:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f48490e30 00010000:00080000:2.0:1788753038.118247:0:14474:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9bbe571800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:2.0:1788753038.118469:0:14474:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788753038.119965:0:14474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788753038.120037:0:14474:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788753038.122391:0:14474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788753038.122507:0:14474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788753038.122638:0:14474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788753038.123283:0:14478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788753038.123289:0:14478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788753038.124022:0:14474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788753038.124034:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788753038.124064:0:14474:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788753038.124087:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f48490e37 00000100:00080000:2.0:1788753038.124107:0:14474:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788753038.124119:0:14474:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c9bbe571800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:2.0:1788753038.124176:0:14474:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bbde9ce00 x1875643182695168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788753038.124211:0:14474:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788753038.124273:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753038.124277:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.124280:0:14474:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788753038.124283:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:3.0:1788753038.124287:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182695168:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1788753038.124287:0:14474:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788753038.124290:0:14474:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788753038.124294:0:14474:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788753038.124297:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788753038.124300:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.124301:0:14474:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788753038.124304:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788753038.124308:0:14474:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788753038.124313:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.124314:0:14474:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788753038.124318:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788753038.124323:0:14474:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.105@tcp to nid 0x20000c0a8cb69 (192.168.203.105@tcp) 00000400:00000100:3.0:1788753038.124346:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875643182695168 offset 0 length 520: 4 00000020:01000000:2.0:1788753038.124349:0:14474:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788753038.124354:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788753038.124364:0:14474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c9ba0063380) 00000020:00000080:2.0:1788753038.124376:0:14474:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788753038.124382:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788753038.124443:0:14474:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788753038.124450:0:14474:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788753038.124455:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x80c8383f48490e45 00010000:00080000:2.0:1788753038.124498:0:14474:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9bbe572000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:2.0:1788753038.124695:0:14474:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788753038.124860:0:14474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788753038.124880:0:14474:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788753038.125621:0:14474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788753038.125706:0:14474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788753038.125799:0:14474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788753038.126367:0:14480:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788753038.126372:0:14480:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788753038.126964:0:14474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788753038.126976:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788753038.127007:0:14474:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788753038.127025:0:14474:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f48490e4c 00000100:00080000:0.0:1788753038.127034:0:14474:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788753038.127044:0:14474:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c9bbe572000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1788753038.127082:0:14474:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9a85e6ed80 x1875643182695296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788753038.127208:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182695296:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788753038.127259:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875643182695296 offset 0 length 520: 4 00000100:00080000:0.0:1788753038.127370:0:14474:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788753038.127472:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788753038.127476:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.127478:0:14474:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788753038.127481:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788753038.127484:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.127486:0:14474:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788753038.127488:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788753038.127490:0:14474:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788753038.127493:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788753038.127495:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.127496:0:14474:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788753038.127498:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788753038.127507:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.127508:0:14474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788753038.127513:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788753038.127538:0:14474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14474:1875643182695424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788753038.127576:0:14474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753038.127602:0:14474:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba04986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788753038.127619:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182695424 00000100:00100000:3.0:1788753038.127627:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182695424 00000100:00100000:3.0:1788753038.127729:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788753038.127738:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14474:x1875643182695424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788753038.128443:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14474:x1875643182695424:12345-0@lo:502:llog_process_th.0 Request processed in 695us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753038.128452:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788753038.128769:0:14474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14474:1875643182695424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788753038.128796:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788753038.128802:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788753038.128803:0:14474:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788753038.128807:0:14474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788753038.129170:0:14437:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788753038.129212:0:14437:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788753038.129230:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031a00/0x80c8383f48490dd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ddc expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.129245:0:14437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b80031a00/0x80c8383f48490dd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ddc expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753038.129254:0:14437:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9bbdf68000 from 1 10000000:01000000:3.0:1788753038.129256:0:14437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788753038.129285:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.129294:0:14437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.129303:0:14437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.129318:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788753038.129348:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.129375:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788753038.129383:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182695552 00000100:00100000:0.0:1788753038.129389:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182695552 00000100:00100000:0.0:1788753038.129424:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788753038.129441:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+9:14437:x1875643182695552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788753038.129452:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753038.129464:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490e53 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.129482:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490e53 expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.129489:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490e53 expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.129494:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c800, rc 0) 00000100:00100000:0.0:1788753038.129526:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+10:14437:x1875643182695552:12345-0@lo:101:mount.lustre.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.129531:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788753038.129548:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753038.129560:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.129568:0:14437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.130172:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695680:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788753038.130269:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.130298:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.130539:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182695680 00000100:00100000:2.0:1788753038.130545:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182695680 00000100:00100000:2.0:1788753038.130594:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788753038.130603:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+10:14437:x1875643182695680:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788753038.130618:0:14450:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788753038.130624:0:14450:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788753038.130710:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+10:14437:x1875643182695680:12345-0@lo:256:mount.lustre.0 Request processed in 108us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753038.130716:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788753038.130884:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695680:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788753038.131527:0:14437:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788753038.131543:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.131553:0:14437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753038.131561:0:14437:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbdf68000 from 1 10000000:01000000:3.0:1788753038.131564:0:14437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788753038.131592:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.131599:0:14437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.131608:0:14437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.131623:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788753038.131656:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.131684:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.131749:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182695808 00000100:00100000:2.0:1788753038.131755:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182695808 00000100:00100000:2.0:1788753038.131793:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788753038.131800:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+10:14437:x1875643182695808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788753038.131810:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753038.131824:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490e61 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.131842:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490e61 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.131852:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490e61 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.131860:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1400, rc 0) 00000100:00100000:2.0:1788753038.132175:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14437:x1875643182695808:12345-0@lo:101:mount.lustre.0 Request processed in 375us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753038.132195:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788753038.132252:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753038.132265:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.132283:0:14437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753038.132330:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753038.132356:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.132382:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788753038.132397:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182695936 00000100:00100000:0.0:1788753038.132402:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182695936 00000100:00100000:0.0:1788753038.132429:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788753038.132437:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14437:x1875643182695936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788753038.132734:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14437:x1875643182695936:12345-0@lo:501:mount.lustre.0 Request processed in 297us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.132741:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788753038.132758:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182695936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753038.132784:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788753038.132819:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.132840:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.132916:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696064 00000100:00100000:2.0:1788753038.132921:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696064 00000100:00100000:2.0:1788753038.132955:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788753038.132962:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14437:x1875643182696064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753038.133201:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14437:x1875643182696064:12345-0@lo:503:mount.lustre.0 Request processed in 239us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.133201:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753038.133208:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788753038.133522:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14482:1875643182696192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788753038.133556:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753038.133587:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:0.0:1788753038.133629:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696192 00000100:00100000:0.0:1788753038.133634:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696192 00000100:00100000:0.0:1788753038.133734:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788753038.133742:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14482:x1875643182696192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788753038.134015:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14482:x1875643182696192:12345-0@lo:502:llog_process_th.0 Request processed in 272us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.134021:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788753038.134106:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14482:1875643182696192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788753038.134157:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753038.134167:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.134173:0:14482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788753038.134181:0:14482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bbdf68000 00000020:00000080:2.0:1788753038.134184:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788753038.134191:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753038.134193:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.134195:0:14482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788753038.134198:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753038.134200:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.134202:0:14482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788753038.134205:0:14482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bbdf68000 00000020:00000080:2.0:1788753038.134207:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788753038.134260:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753038.134263:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.134265:0:14482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788753038.134273:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753038.134276:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753038.134278:0:14482:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788753038.134281:0:14482:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c9bbdf68000 00000020:00000080:2.0:1788753038.134283:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788753038.134312:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14482:1875643182696320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788753038.134337:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753038.134362:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:3.0:1788753038.134377:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696320 00000100:00100000:3.0:1788753038.134382:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696320 00000100:00100000:3.0:1788753038.134417:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788753038.134423:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14482:x1875643182696320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788753038.134550:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14482:x1875643182696320:12345-0@lo:502:llog_process_th.0 Request processed in 127us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753038.134557:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788753038.134690:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14482:1875643182696320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788753038.134710:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788753038.134714:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788753038.134716:0:14482:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788753038.134719:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788753038.134952:0:14437:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788753038.134971:0:14437:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788753038.134991:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.135342:0:14437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788753038.135440:0:14437:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788753038.135444:0:14437:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c9bbdf68000 10000000:01000000:2.0:1788753038.135447:0:14437:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c9bbdf68000 10000000:01000000:2.0:1788753038.135451:0:14437:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788753038.135457:0:14437:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9bbdf68000 from 1 10000000:01000000:2.0:1788753038.135460:0:14437:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788753038.135490:0:14437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0400/0x80c8383f48490e6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.135499:0:14437:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0400/0x80c8383f48490e6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.135508:0:14437:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0400/0x80c8383f48490e6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753038.135523:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788753038.135563:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753038.135627:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe0936c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788753038.135677:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696448 00000100:00100000:1.0:1788753038.135684:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696448 00000100:00100000:1.0:1788753038.135721:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788753038.135734:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14437:x1875643182696448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753038.135747:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753038.135759:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe270400/0x80c8383f48490e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490e6f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.135782:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe270400/0x80c8383f48490e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490e6f expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.135792:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe270400/0x80c8383f48490e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490e6f expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.135800:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270400, rc 0) 00000100:00100000:1.0:1788753038.135971:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14437:x1875643182696448:12345-0@lo:101:mount.lustre.0 Request processed in 236us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753038.135977:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788753038.137015:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788753038.137035:0:14437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0400/0x80c8383f48490e6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e76 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.137059:0:14437:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0400/0x80c8383f48490e6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490e76 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753038.137160:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753038.137209:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.137253:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696576 00000100:00100000:2.0:1788753038.137257:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe0936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788753038.137264:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696576 00000100:00100000:3.0:1788753038.137304:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788753038.137310:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14437:x1875643182696576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753038.137548:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14437:x1875643182696576:12345-0@lo:501:mount.lustre.0 Request processed in 236us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753038.137556:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788753038.137559:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753038.137612:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753038.137650:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753038.137667:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe0936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788753038.137977:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696704 00000100:00100000:3.0:1788753038.137983:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696704 00000100:00100000:3.0:1788753038.138016:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788753038.138024:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14437:x1875643182696704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788753038.138206:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14437:x1875643182696704:12345-0@lo:503:mount.lustre.0 Request processed in 181us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753038.138214:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788753038.138217:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182696704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788753038.138479:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14485:1875643182696832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788753038.138519:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.138582:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788753038.138614:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696832 00000100:00100000:0.0:1788753038.138620:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696832 00000100:00100000:0.0:1788753038.138740:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788753038.138747:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14485:x1875643182696832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788753038.139005:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14485:x1875643182696832:12345-0@lo:502:llog_process_th.0 Request processed in 257us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.139012:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788753038.139219:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14485:1875643182696832:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788753038.139275:0:14485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788753038.139289:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c9b8731b380) 00000020:00000080:0.0:1788753038.139305:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788753038.139385:0:14485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bbdf68000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788753038.139390:0:14485:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9bbdf68000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788753038.139393:0:14485:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bbdf68000 4 00010000:00080000:0.0:1788753038.139425:0:14485:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9b9149c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.105@tcp at head 00010000:00010000:0.0:1788753038.142026:0:14485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788753038.144502:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788753038.144550:0:14485:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788753038.144563:0:14485:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x80c8383f48490e84 00000100:00080000:0.0:1788753038.144573:0:14485:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788753038.144584:0:14485:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c9b9149c000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1788753038.144619:0:14485:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9a85e6ea00 x1875643182696960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788753038.144660:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182696960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788753038.144723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753038.146291:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182696960 00000100:00100000:0.0:1788753038.146302:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182696960 00000100:00100000:0.0:1788753038.146346:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788753038.146354:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875643182696960:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788753038.146434:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875643182696960:12345-0@lo:38:llog_process_th.0 Request processed in 80us (1710us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788753038.146441:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788753038.146490:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788753038.146499:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b9149c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788753038.146518:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788753038.146522:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182696960:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788753038.146543:0:14485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788753038.147302:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14485:1875643182697088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788753038.149344:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753038.149391:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9246a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788753038.149444:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697088 00000100:00100000:2.0:1788753038.149453:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697088 00000100:00100000:2.0:1788753038.149509:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788753038.149520:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14485:x1875643182697088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788753038.149916:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14485:x1875643182697088:12345-0@lo:502:llog_process_th.0 Request processed in 397us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753038.149925:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788753038.150318:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cf43312c-18dc-4b92-a763-9e6fba828a91:14485:1875643182697088:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788753038.150354:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788753038.150519:0:14437:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788753038.150554:0:14437:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788753038.150610:0:14437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0400/0x80c8383f48490e6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e76 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.150623:0:14437:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0400/0x80c8383f48490e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e76 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788753038.150742:0:14437:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788753038.150744:0:14437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788753038.150746:0:14437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788753038.150747:0:14437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788753038.150752:0:14437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788753038.150754:0:14437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788753038.150755:0:14437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788753038.150757:0:14437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788753038.150758:0:14437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788753038.150760:0:14437:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788753038.150763:0:14437:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788753038.150766:0:14437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788753038.150767:0:14437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788753038.150768:0:14437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788753038.150769:0:14437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788753038.150770:0:14437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788753038.150771:0:14437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788753038.150772:0:14437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788753038.150773:0:14437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788753038.150774:0:14437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788753038.150775:0:14437:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788753038.150873:0:14437:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788753038.150890:0:14437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182697216:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788753038.150937:0:14437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753038.150969:0:14437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8a7dc900 going to sleep for 11 seconds 00000100:00100000:0.0:1788753038.151014:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697216 00000100:00100000:0.0:1788753038.151021:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697216 00000100:00100000:0.0:1788753038.151060:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788753038.151069:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14437:x1875643182697216:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788753038.151093:0:14450:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788753038.151117:0:14450:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788753038.183119:0:14450:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788753038.183269:0:14450:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788753038.183336:0:14472:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788753038.183340:0:14472:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788753038.183359:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.183378:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490e53 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.183404:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.183442:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f48490e53 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753038.183455:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f48490e53 expref: 12 pid: 14449 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753038.183469:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14472:1875643182697344:0@lo:104: 00000100:00100000:2.0:1788753038.183527:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753038.183603:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9201d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788753038.184335:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697344 00000100:00100000:1.0:1788753038.184346:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697344 00000100:00100000:1.0:1788753038.184479:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788753038.184490:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14472:x1875643182697344:12345-0@lo:104: 00010000:00010000:1.0:1788753038.184504:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753038.184622:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788753038.184628:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14472:x1875643182697344:12345-0@lo:104: Request processed in 141us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753038.184635:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788753038.184685:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753038.184692:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.184701:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788753038.184704:0:14444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.184714:0:14444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788753038.184722:0:14444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753038.184741:0:14444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1788753038.184748:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14472:1875643182697344:0@lo:104: 00010000:00010000:2.0:1788753038.184769:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.184782:0:14444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.184790:0:14444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788753038.184811:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.184818:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b80030800/0x80c8383f48490e53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e5a expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753038.184837:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753038.184839:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753038.184841:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788753038.184861:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788753038.184871:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cf43312c-18dc-4b92-a763-9e6fba828a91:3305:1875643182697472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788753038.184905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753038.184966:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697472 00000100:00100000:0.0:1788753038.184971:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697472 00010000:00010000:0.0:1788753038.184990:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490e53 expref: 13 pid: 14449 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753038.185009:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788753038.185016:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+13:3305:x1875643182697472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788753038.185026:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788753038.185032:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490e53 expref: 13 pid: 14449 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185043:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f48490e53 expref: 13 pid: 14449 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185056:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9a85e4c800/0x80c8383f48490e5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f48490e53 expref: 13 pid: 14449 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185069:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185085:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788753038.185107:0:14440:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001768120s 00010000:00010000:0.0:1788753038.185112:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185120:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185151:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185158:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185165:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1e00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753038.185169:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185176:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185190:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185200:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788753038.185231:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:3305:x1875643182697472:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.185239:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788753038.185277:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cf43312c-18dc-4b92-a763-9e6fba828a91:3305:1875643182697472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788753038.185298:0:14472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185305:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753038.185312:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bb55b1e00/0x80c8383f48490e8b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753038.192650:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14437:x1875643182697216:12345-0@lo:253:mount.lustre.0 Request processed in 41574us (41704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753038.192664:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788753038.192786:0:14437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:14437:1875643182697216:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788753038.192800:0:14437:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788753038.192803:0:14437:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788753038.192805:0:14437:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788753038.192806:0:14437:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788753038.192807:0:14437:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788753038.192808:0:14437:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788753038.192809:0:14437:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788753038.192811:0:14437:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788753038.192812:0:14437:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788753038.192814:0:14437:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788753038.192815:0:14437:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788753038.192831:0:14437:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788753038.200756:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788753038.200925:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788753038.201277:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788753038.201439:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788753038.201701:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788753038.201860:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788753038.203830:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788753038.204005:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788753038.204515:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788753038.204817:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788753038.205086:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788753038.205336:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788753038.243079:0:14437:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788753038.243510:0:14437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788753038.243600:0:14495:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788753038.243605:0:14495:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788753038.244443:0:14496:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788753038.244502:0:14496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788753038.249657:0:14496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788753038.249966:0:14496:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788753038.249972:0:14496:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788753038.250194:0:14437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788753038.250346:0:14437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788753038.251302:0:14437:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788753038.251318:0:14437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788753038.251699:0:14437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788753038.253361:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788753038.254494:0:14437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788753038.254547:0:14437:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788753038.255365:0:14437:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1788753038.257614:0:14437:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788753038.264844:0:14437:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788753038.298345:0:14437:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788753038.298454:0:14437:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffab8a0195b988 00100000:10000000:2.0:1788753038.298462:0:14437:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788753038.299616:0:14437:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788753038.299633:0:14437:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788753038.299651:0:14437:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788753038.299677:0:14437:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788753038.956026:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788753039.210762:0:14489:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788753039.210772:0:14489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788753039.213267:0:14489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:0.0:1788753039.213282:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1788753039.914202:0:14453:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788753039.914210:0:14453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9bbdf68000 from 6 10000000:01000000:0.0:1788753039.914215:0:14453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788753039.914281:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753039.914293:0:14453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753039.914306:0:14453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753039.914332:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182697600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788753039.914398:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753039.914467:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f77dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788753039.914585:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697600 00000100:00100000:2.0:1788753039.914592:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697600 00000100:00100000:2.0:1788753039.914651:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788753039.914661:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14453:x1875643182697600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788753039.914674:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753039.914688:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490e92 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753039.914712:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490e92 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753039.914723:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490e92 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753039.914731:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0c00, rc 0) 00000100:00100000:2.0:1788753039.914777:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182697600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753039.914783:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788753039.914867:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182697600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788753039.914882:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753039.914890:0:14453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753039.914948:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182697728:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788753039.914980:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753039.915004:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbd91db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788753039.915114:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697728 00000100:00100000:2.0:1788753039.915119:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697728 00000100:00100000:2.0:1788753039.915179:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788753039.915185:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182697728:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788753039.915198:0:14450:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788753039.915214:0:14450:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788753039.915217:0:14450:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788753039.915297:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182697728:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753039.915311:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788753039.915342:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182697728:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788753039.915382:0:14453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788753039.915389:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753039.915397:0:14453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753039.983894:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788753040.235514:0:14489:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788753040.235524:0:14489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788753040.236408:0:14489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788753040.236479:0:14489:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788753040.236509:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1788753041.002931:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753042.026700:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788753042.251115:0:14739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788753043.054563:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788753043.630909:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788753043.630916:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788753043.630919:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788753043.630922:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788753043.630924:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788753043.630928:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788753043.630932:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c9b9149c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788753043.630947:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c9b9149c000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:0.0:1788753043.630978:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182697856:0@lo:400:kworker.0 00000100:00100000:0.0:1788753043.631040:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753043.632717:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697856 00000100:00100000:2.0:1788753043.632730:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697856 00000100:00100000:2.0:1788753043.632783:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788753043.632801:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:3303:x1875643182697856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753043.632883:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:3303:x1875643182697856:12345-0@lo:400:kworker.0 Request processed in 90us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753043.632894:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788753043.632956:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182697856:0@lo:400:kworker.0 00000100:00100000:0.0:1788753043.633112:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9a85e6c380 x1875643182697984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788753043.633185:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182697984:0@lo:38:kworker.0 00000100:00100000:2.0:1788753043.633231:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753043.633572:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182697984 00000100:00100000:1.0:1788753043.633796:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182697984 00000100:00100000:1.0:1788753043.634015:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788753043.634026:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3302:x1875643182697984:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788753043.634930:0:14457:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1788753043.634977:0:14457:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x80c8383f48490ea0 00000004:00100000:1.0:1788753043.634997:0:14457:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788753043.635197:0:14457:0:(import.c:65:import_set_state_nolock()) ffff9c9b88998800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788753043.635283:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875643182697984:12345-0@lo:38:kworker.0 Request processed in 1255us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753043.635290:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788753043.636441:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c9a85e6c380 x1875643182697984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788753053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788753043.636460:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788753043.636469:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788753043.636479:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788753043.636483:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b9149c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788753043.636490:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875643182697984:0@lo:38:kworker.0 00010000:00010000:2.0:1788753044.074329:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788753044.752899:0:14890:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe9907dec0 20000000:00000080:0.0:1788753044.752920:0:14890:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c9ba7b99c00 uarg=0000000000000000 20000000:01000000:0.0:1788753044.752955:0:14890:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788753044.752962:0:14890:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788753044.752966:0:14890:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788753044.753578:0:14891:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788753044.754496:0:14890:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788753044.761495:0:14890:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788753044.761529:0:14890:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753044.761616:0:14890:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490e61 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753044.761626:0:14890:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753044.761670:0:14890:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f48490e61 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753044.761750:0:14890:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f48490e61 expref: 11 pid: 14447 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753044.761765:0:14890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14890:1875643182698112:0@lo:104: 00000100:00100000:3.0:1788753044.761919:0:14890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753044.762041:0:14890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788753044.762101:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182698112 00000100:00100000:1.0:1788753044.762109:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182698112 00000100:00100000:1.0:1788753044.763568:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788753044.763581:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14890:x1875643182698112:12345-0@lo:104: 00010000:00010000:1.0:1788753044.763598:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753044.763683:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788753044.763689:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14890:x1875643182698112:12345-0@lo:104: Request processed in 113us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753044.763697:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788753044.763739:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753044.763745:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.763752:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80031400 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788753044.763756:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.763763:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788753044.763770:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788753044.763775:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788753044.764015:0:14890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14890:1875643182698112:0@lo:104: 00010000:00010000:3.0:1788753044.764038:0:14890:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764115:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764152:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788753044.764173:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764180:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9b80031400/0x80c8383f48490e61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e68 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764218:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753044.764220:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753044.764221:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788753044.764236:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788753044.764248:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182698240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788753044.764289:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753044.764328:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182698240 00000100:00100000:0.0:1788753044.764335:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182698240 00010000:00010000:0.0:1788753044.764356:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490e61 expref: 12 pid: 14447 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753044.764379:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788753044.764385:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:3303:x1875643182698240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788753044.764396:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788753044.764400:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490e61 expref: 12 pid: 14447 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764410:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f48490e61 expref: 12 pid: 14447 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764423:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bb55b1400/0x80c8383f48490e68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f48490e61 expref: 12 pid: 14447 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764436:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764445:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764468:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764475:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764481:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764487:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764492:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2172000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753044.764495:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764502:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764513:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753044.764531:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788753044.764563:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+11:3303:x1875643182698240:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753044.764570:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788753044.764600:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182698240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788753044.764715:0:14890:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753044.764723:0:14890:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753044.764729:0:14890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490ea7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753045.099222:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753046.122275:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788753046.316217:0:14453:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788753046.316231:0:14453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbdf68000 from 10 10000000:01000000:0.0:1788753046.316236:0:14453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788753046.316276:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753046.316287:0:14453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753046.316298:0:14453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753046.316332:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182698368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788753046.316397:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753046.316437:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788753046.316457:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182698368 00000100:00100000:0.0:1788753046.316464:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182698368 00000100:00100000:0.0:1788753046.316510:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788753046.316518:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+11:14453:x1875643182698368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788753046.316530:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753046.316541:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490eae expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753046.316563:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490eae expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753046.316572:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490eae expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753046.316590:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c000, rc 0) 00000100:00100000:0.0:1788753046.316631:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182698368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753046.316642:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788753046.316688:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182698368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788753046.316701:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753046.316708:0:14453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753046.316754:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182698496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753046.316774:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753046.316787:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788753046.316797:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182698496 00000100:00100000:0.0:1788753046.316799:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182698496 00000100:00100000:0.0:1788753046.316816:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788753046.316821:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182698496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753046.317028:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182698496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 206us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753046.317034:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788753046.317071:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182698496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753046.317094:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182698624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788753046.317148:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753046.317161:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788753046.317171:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182698624 00000100:00100000:0.0:1788753046.317174:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182698624 00000100:00100000:0.0:1788753046.317192:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788753046.317202:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182698624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788753046.317324:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:14453:x1875643182698624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753046.317330:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788753046.317361:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182698624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788753046.319354:0:14958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788753046.319768:0:14453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788753046.319788:0:14453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788753046.319798:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753046.319869:0:14453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753047.149701:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753048.176263:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788753048.746319:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788753038/real 1788753038] req@ffff9c9a85e6ed80 x1875643182695296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788753048.746353:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c9a85e6ed80 x1875643182695296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788753048.746363:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788753038/real 1788753038] req@ffff9c9bbde9ce00 x1875643182695168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753048 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788753048.746373:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c9bbde9ce00 x1875643182695168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753048 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788753048.746390:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe572000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788753048.746415:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788753048.746419:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182695296:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788753048.746425:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe571800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788753048.746430:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788753048.746432:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182695168:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788753048.746545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753048.746550:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788753048.746553:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe571800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788753048.746685:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1788753048.746690:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788753048.746700:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c9bbe571800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1788753048.746720:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bb57b9f80 x1875643182698880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788753048.746733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753048.746736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788753048.746737:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe572000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788753048.746740:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 437 00000100:00080000:3.0:1788753048.746743:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788753048.746755:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c9bbe572000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1788753048.746768:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bb57b8000 x1875643182699008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788753048.746840:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182699136:0@lo:400:kworker.0 00000100:00100000:2.0:1788753048.746895:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753048.746952:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788753048.746959:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182698752:0@lo:400:kworker.0 00000100:00100000:2.0:1788753048.746990:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753048.747037:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182698752 00000100:00100000:2.0:1788753048.747044:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182698752 00000100:00100000:2.0:1788753048.747087:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788753048.747095:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+12:3306:x1875643182698752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753048.747165:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+12:3306:x1875643182698752:12345-0@lo:400:kworker.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753048.747172:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788753048.747471:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182698880:0@lo:8:kworker.0 00000400:00000100:2.0:1788753048.747496:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875643182698880 offset 0 length 520: 4 00000100:00100000:2.0:1788753048.747510:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182699008:0@lo:8:kworker.0 00000400:00000100:2.0:1788753048.747526:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875643182699008 offset 0 length 520: 4 00000100:00100000:3.0:1788753048.747734:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182699136 00000100:00100000:3.0:1788753048.747740:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182699136 00000100:00100000:3.0:1788753048.747824:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788753048.747832:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182699136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788753048.747871:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875643182699136:12345-0@lo:400:kworker.0 Request processed in 41us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753048.747878:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788753048.749427:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182698752:0@lo:400:kworker.0 00010000:00080000:2.0:1788753048.749445:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c9bb57bb480 x1875643182699136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788753048.749456:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875643182699136:0@lo:400:kworker.0 00000020:01000004:2.0:1788753048.977651:0:15140:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788753048.977655:0:15140:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788753048.977784:0:15140:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c9a849f0000 00000020:01000004:2.0:1788753048.977799:0:15140:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788753048.977810:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788753048.977822:0:15140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c9ba0064d40) 00000020:00000080:2.0:1788753048.977835:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788753048.997468:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788753048.998010:0:15140:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788753048.999193:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788753048.999417:0:15140:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788753048.999672:0:15140:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788753049.004850:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788753049.005006:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788753049.005100:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788753049.005554:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 342: rc = 0 00100000:10000000:2.0:1788753049.005867:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 342: rc = 0 00100000:10000000:2.0:1788753049.006112:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 342: rc = 0 00100000:10000000:2.0:1788753049.006393:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 342: rc = 0 00100000:10000000:2.0:1788753049.006633:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 342: rc = 0 00100000:10000000:3.0:1788753049.009879:0:15140:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 342: rc = 0 00000020:00000080:3.0:1788753049.010513:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788753049.010523:0:15140:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788753049.010532:0:15140:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x80c8383f48490ec3 00000020:01000004:3.0:1788753049.010539:0:15140:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788753049.010557:0:15140:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788753049.010560:0:15140:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788753049.010565:0:15140:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788753049.010569:0:15140:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788753049.010580:0:15140:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c9a849e99c0) 00000020:00000080:3.0:1788753049.010590:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788753049.011601:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753049.011741:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788753049.011748:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788753049.015696:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788753049.015710:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788753049.016216:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788753049.016224:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788753049.024354:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753049.024539:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788753049.024546:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788753049.033218:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788753049.033241:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788753049.060473:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788753049.060702:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788753049.060709:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788753049.062559:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788753049.062578:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788753049.066256:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788753049.066273:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788753049.070602:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788753049.070787:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788753049.070793:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788753049.073373:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788753049.073458:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788753049.108502:0:15140:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788753049.108686:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788753049.108692:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788753049.112672:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788753049.112685:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788753049.113500:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788753049.113525:0:15140:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788753049.113532:0:15140:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788753049.123099:0:15140:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788753049.123153:0:15140:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.105@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788753049.123157:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788753049.123159:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788753049.123160:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788753049.123161:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788753049.123162:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788753049.123167:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788753049.123169:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788753049.123171:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788753049.123172:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788753049.123175:0:15140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788753049.123177:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788753049.123178:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788753049.123179:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788753049.123180:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788753049.123181:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788753049.123182:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788753049.123182:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788753049.123183:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788753049.123184:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788753049.123206:0:15140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788753049.123224:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699264:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788753049.123294:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.123404:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0486180 going to sleep for 11 seconds 00000100:00100000:0.0:1788753049.123448:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182699264 00000100:00100000:0.0:1788753049.123456:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182699264 00000100:00100000:0.0:1788753049.123581:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788753049.123592:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:15140:x1875643182699264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788753049.123620:0:14447:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788753049.123623:0:14447:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788753049.123627:0:14447:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788753049.134362:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+12:15140:x1875643182699264:12345-0@lo:253:mount.lustre.0 Request processed in 10764us (11059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.134375:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788753049.134452:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699264:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788753049.134467:0:15140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788753049.134470:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788753049.134472:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788753049.134473:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788753049.134474:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788753049.134475:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788753049.134476:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788753049.134477:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788753049.134479:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788753049.134480:0:15140:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788753049.134497:0:15140:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c9a849f0000 from lustre-OST0000 10000000:01000000:2.0:1788753049.134522:0:15140:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788753049.134525:0:15140:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788753049.134531:0:15140:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c9a84163380 local copy 00010000:00010000:2.0:1788753049.134541:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753049.134817:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753049.134850:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.134920:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0486d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788753049.134961:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182699392 00000100:00100000:0.0:1788753049.134967:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182699392 00000100:00100000:0.0:1788753049.135039:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788753049.135049:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:15140:x1875643182699392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788753049.135256:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+12:15140:x1875643182699392:12345-0@lo:501:mount.lustre.0 Request processed in 209us (404us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788753049.135263:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788753049.135336:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699392:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788753049.135353:0:15140:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788753049.135523:0:15140:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788753049.135531:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.135541:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788753049.135566:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c9a849f0000 10000000:01000000:1.0:1788753049.135571:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788753049.135576:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c9a84163380 10000000:01000000:1.0:1788753049.135578:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788753049.135581:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c9a84163380 from 1 10000000:01000000:1.0:1788753049.135584:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788753049.135615:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271e00/0x80c8383f48490ed1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.135623:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271e00/0x80c8383f48490ed1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.135632:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271e00/0x80c8383f48490ed1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753049.135645:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788753049.135687:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.135870:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788753049.135955:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182699520 00000100:00100000:2.0:1788753049.135961:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182699520 00000100:00100000:2.0:1788753049.135985:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788753049.135991:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+12:15140:x1875643182699520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788753049.136001:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753049.136015:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b1c00/0x80c8383f48490ed8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490ed1 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.136045:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b1c00/0x80c8383f48490ed8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490ed1 expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.136056:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b1c00/0x80c8383f48490ed8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490ed1 expref: 13 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.136064:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1c00, rc 0) 00000100:00100000:2.0:1788753049.136102:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+13:15140:x1875643182699520:12345-0@lo:101:mount.lustre.0 Request processed in 109us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.136108:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788753049.136200:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753049.136212:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271e00/0x80c8383f48490ed1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ed8 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.136221:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271e00/0x80c8383f48490ed1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490ed8 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788753049.136237:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788753049.136255:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271e00/0x80c8383f48490ed1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ed8 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.136262:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271e00/0x80c8383f48490ed1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ed8 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788753049.136268:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788753049.136272:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788753049.136278:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788753049.136286:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788753049.136300:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270000/0x80c8383f48490edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.136306:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270000/0x80c8383f48490edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.136314:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270000/0x80c8383f48490edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753049.136326:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788753049.136351:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.136367:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788753049.136430:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182699648 00000100:00100000:2.0:1788753049.136434:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182699648 00000100:00100000:2.0:1788753049.136450:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788753049.136456:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+13:15140:x1875643182699648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788753049.136464:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753049.136478:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b1800/0x80c8383f48490ee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490edf expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.136492:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b1800/0x80c8383f48490ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490edf expref: 14 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.136501:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b1800/0x80c8383f48490ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490edf expref: 14 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.136508:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1800, rc 0) 00000100:00100000:2.0:1788753049.136544:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182699648:12345-0@lo:101:mount.lustre.0 Request processed in 87us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.136549:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788753049.136611:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753049.136622:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270000/0x80c8383f48490edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ee6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.136629:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270000/0x80c8383f48490edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490ee6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788753049.137237:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788753049.138062:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788753049.138354:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788753049.138401:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788753049.138436:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788753049.138480:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788753049.138515:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788753049.138548:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788753049.138611:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788753049.138619:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788753049.138696:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788753049.138756:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.138778:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788753049.138942:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182699776 00000100:00100000:2.0:1788753049.138950:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182699776 00000100:00100000:2.0:1788753049.138986:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788753049.138995:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182699776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753049.139347:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182699776:12345-0@lo:501:mount.lustre.0 Request processed in 353us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.139355:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788753049.139501:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788753049.139529:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788753049.139567:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.139592:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788753049.139636:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182699904 00000100:00100000:2.0:1788753049.139640:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182699904 00000100:00100000:2.0:1788753049.139670:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788753049.139677:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182699904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753049.139954:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182699904:12345-0@lo:503:mount.lustre.0 Request processed in 278us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.139962:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788753049.140106:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182699904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788753049.140620:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788753049.140739:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788753049.140781:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.140802:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18baf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788753049.140866:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700032 00000100:00100000:2.0:1788753049.140877:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700032 00000100:00100000:2.0:1788753049.140900:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788753049.140907:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182700032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753049.141108:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182700032:12345-0@lo:502:mount.lustre.0 Request processed in 201us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.141115:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788753049.141389:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788753049.141619:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788753049.141774:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788753049.141812:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788753049.141860:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788753049.141897:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788753049.141931:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788753049.141989:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788753049.142039:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788753049.142074:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788753049.142119:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788753049.142363:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788753049.142414:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788753049.142447:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788753049.142502:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.142574:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18baf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788753049.142628:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700160 00000100:00100000:3.0:1788753049.142634:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700160 00000100:00100000:2.0:1788753049.144214:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788753049.144234:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182700160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753049.144519:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182700160:12345-0@lo:502:mount.lustre.0 Request processed in 293us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.144527:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788753049.147246:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788753049.147394:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788753049.147410:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788753049.148625:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788753049.148634:0:15154:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788753049.148640:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788753049.148642:0:15154:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788753049.148648:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788753049.148727:0:15154:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c9a849eb380) 00000020:00000080:3.0:1788753049.148748:0:15154:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788753049.148755:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788753049.148813:0:15154:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9a849f0000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788753049.148821:0:15154:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788753049.148829:0:15154:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x80c8383f48490ef4 00010000:00010000:2.0:1788753049.152740:0:15154:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788753049.153242:0:15154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788753049.155111:0:15154:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788753049.156571:0:15154:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788753049.156582:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753049.156588:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753049.156590:0:15154:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788753049.156594:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788753049.156596:0:15154:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788753049.156598:0:15154:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788753049.156599:0:15154:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788753049.156601:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788753049.156603:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753049.156604:0:15154:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788753049.156607:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753049.156610:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753049.156611:0:15154:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788753049.156614:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788753049.156616:0:15154:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788753049.156625:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753049.156628:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753049.156629:0:15154:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788753049.156632:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753049.156634:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753049.156635:0:15154:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788753049.156638:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788753049.156752:0:15154:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753049.156757:0:15154:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753049.156758:0:15154:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788753049.156762:0:15154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788753049.156902:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788753049.156930:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788753049.156953:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270000/0x80c8383f48490edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ee6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.156965:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270000/0x80c8383f48490edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490ee6 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788753049.156974:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9a849f0000 from 1 10000000:01000000:1.0:1788753049.156977:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788753049.157011:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.157019:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.157041:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753049.157066:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788753049.157151:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.157195:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18ba900 going to sleep for 11 seconds 00000100:00100000:3.0:1788753049.157268:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700288 00000100:00100000:3.0:1788753049.157276:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700288 00000100:00100000:3.0:1788753049.157319:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788753049.157328:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+14:15140:x1875643182700288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753049.157340:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753049.157351:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490efb expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.157371:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490efb expref: 15 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.157388:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490efb expref: 15 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.157397:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2172000, rc 0) 00000100:00100000:3.0:1788753049.157431:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700288:12345-0@lo:101:mount.lustre.0 Request processed in 104us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753049.157437:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788753049.157519:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753049.157534:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753049.157552:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788753049.158050:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788753049.158475:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788753049.158815:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788753049.158856:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788753049.158913:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788753049.158923:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788753049.158986:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788753049.159045:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753049.159081:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba18ba900 going to sleep for 11 seconds 00000100:00100000:1.0:1788753049.159167:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700416 00000100:00100000:1.0:1788753049.159174:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700416 00000100:00100000:1.0:1788753049.159307:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788753049.159317:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788753049.159504:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700416:12345-0@lo:501:mount.lustre.0 Request processed in 189us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753049.159512:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788753049.159573:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753049.159604:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700544:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753049.159641:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.161866:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9780 going to sleep for 11 seconds 00000100:00100000:3.0:1788753049.161905:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700544 00000100:00100000:3.0:1788753049.161915:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700544 00000100:00100000:3.0:1788753049.161956:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788753049.161965:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788753049.162212:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700544:12345-0@lo:503:mount.lustre.0 Request processed in 247us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753049.162220:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788753049.163817:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788753049.164589:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788753049.165547:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753049.165622:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.165736:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788753049.165814:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700672 00000100:00100000:0.0:1788753049.165821:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700672 00000100:00100000:0.0:1788753049.165856:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788753049.165865:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788753049.166071:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700672:12345-0@lo:502:mount.lustre.0 Request processed in 206us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.166078:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788753049.166429:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788753049.167257:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788753049.167321:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788753049.167382:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788753049.167419:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788753049.167449:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788753049.167492:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788753049.167530:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788753049.167563:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788753049.167610:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753049.167742:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.168787:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788753049.168854:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700800 00000100:00100000:1.0:1788753049.168863:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700800 00000100:00100000:0.0:1788753049.169477:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788753049.169489:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700800:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788753049.169845:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700800:12345-0@lo:502:mount.lustre.0 Request processed in 359us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.169853:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788753049.170008:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788753049.170314:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788753049.170329:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788753049.171099:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788753049.171109:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788753049.171112:0:15158:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788753049.171311:0:15158:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9a849f0000 00000020:00000080:1.0:1788753049.171317:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788753049.171324:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788753049.171327:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788753049.171335:0:15158:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788753049.171338:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788753049.171341:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788753049.171343:0:15158:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788753049.171346:0:15158:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9a849f0000 00000020:00000080:1.0:1788753049.171348:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788753049.171428:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788753049.171432:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788753049.171433:0:15158:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788753049.171436:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788753049.171438:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788753049.171439:0:15158:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788753049.171442:0:15158:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c9a849f0000 00000020:00000080:1.0:1788753049.171444:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788753049.172797:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788753049.172804:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788753049.172807:0:15158:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788753049.172811:0:15158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788753049.178984:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788753049.179039:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788753049.179064:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.179078:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753049.179148:0:15140:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788753049.179151:0:15140:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c9a849f0000 10000000:01000000:3.0:1788753049.179154:0:15140:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c9a849f0000 10000000:01000000:3.0:1788753049.179158:0:15140:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788753049.179163:0:15140:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9a849f0000 from 1 10000000:01000000:3.0:1788753049.179174:0:15140:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788753049.179208:0:15140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2172a00/0x80c8383f48490f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.179217:0:15140:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bc2172a00/0x80c8383f48490f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.179229:0:15140:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bc2172a00/0x80c8383f48490f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753049.179254:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788753049.179319:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753049.182752:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182700928 00000100:00100000:0.0:1788753049.182767:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182700928 00000100:00100000:3.0:1788753049.182826:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788753049.182861:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788753049.182875:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182700928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788753049.182893:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753049.182913:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4cc00/0x80c8383f48490f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490f09 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.182939:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4cc00/0x80c8383f48490f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490f09 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.182951:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9a85e4cc00/0x80c8383f48490f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490f09 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.182966:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4cc00, rc 0) 00000100:00100000:0.0:1788753049.183044:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182700928:12345-0@lo:101:mount.lustre.0 Request processed in 174us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.183051:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788753049.183153:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182700928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753049.183170:0:15140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bc2172a00/0x80c8383f48490f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f10 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.183179:0:15140:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bc2172a00/0x80c8383f48490f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490f10 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788753049.183821:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788753049.184152:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788753049.184385:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788753049.184423:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788753049.184467:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788753049.184510:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788753049.184545:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788753049.184591:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788753049.184625:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788753049.185999:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788753049.186142:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788753049.186182:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788753049.186217:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788753049.186267:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788753049.186303:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788753049.186339:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788753049.186389:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788753049.186424:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788753049.186459:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788753049.186506:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788753049.186558:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788753049.186593:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788753049.186640:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788753049.187829:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788753049.187867:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788753049.187936:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788753049.187974:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788753049.188006:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788753049.188064:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788753049.188097:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788753049.188195:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788753049.188203:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788753049.188294:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753049.188355:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753049.188617:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788753049.190240:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701056 00000100:00100000:0.0:1788753049.190251:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701056 00000100:00100000:0.0:1788753049.190339:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788753049.190349:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788753049.190629:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701056:12345-0@lo:501:mount.lustre.0 Request processed in 281us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.190637:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788753049.192875:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788753049.192928:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788753049.192989:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753049.193427:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701184 00000100:00100000:0.0:1788753049.193433:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701184 00000100:00100000:0.0:1788753049.193479:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788753049.193488:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788753049.193726:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701184:12345-0@lo:503:mount.lustre.0 Request processed in 238us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.193734:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788753049.194051:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b386c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788753049.194069:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701184:0@lo:503:mount.lustre.0 00010000:00010000:0.0:1788753049.195205:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788753049.197048:0:15140:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788753049.197475:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753049.197552:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.197588:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0ed5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788753049.197735:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701312 00000100:00100000:0.0:1788753049.197742:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701312 00000100:00100000:0.0:1788753049.197788:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788753049.197798:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788753049.198042:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701312:12345-0@lo:502:mount.lustre.0 Request processed in 242us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.198060:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788753049.198077:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788753049.198460:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788753049.198519:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788753049.198580:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788753049.198644:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788753049.198797:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788753049.198862:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788753049.198926:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788753049.198973:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788753049.199000:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788753049.199018:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788753049.199055:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788753049.199102:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788753049.199171:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788753049.199220:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788753049.199279:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788753049.199328:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788753049.199361:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788753049.199409:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788753049.199458:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788753049.199490:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788753049.199539:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788753049.199575:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788753049.199609:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788753049.199653:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788753049.199763:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788753049.199798:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788753049.199868:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788753049.199908:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788753049.199941:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788753049.199997:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788753049.200045:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788753049.200077:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788753049.200109:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788753049.200183:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788753049.200233:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788753049.200281:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788753049.200319:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788753049.200352:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788753049.200400:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788753049.200436:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788753049.200481:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753049.200550:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.200598:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0ed5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788753049.200651:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701440 00000100:00100000:0.0:1788753049.200715:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701440 00000100:00100000:0.0:1788753049.200755:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788753049.200764:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788753049.200992:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701440:12345-0@lo:502:mount.lustre.0 Request processed in 229us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.200998:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788753049.201085:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788753049.201190:0:15140:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788753049.201201:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788753049.205278:0:15163:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788753049.205304:0:15163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c9b88b44d40) 00000020:00000080:1.0:1788753049.205330:0:15163:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788753049.205418:0:15163:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9a849f0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788753049.205422:0:15163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9a849f0000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788753049.205425:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9a849f0000 3 00010000:00080000:1.0:1788753049.205722:0:15163:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9b90a5a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.105@tcp at head 00010000:00010000:1.0:1788753049.209312:0:15163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788753049.211511:0:15163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788753049.211559:0:15163:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788753049.211573:0:15163:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x80c8383f48490f1e 00000100:00080000:1.0:1788753049.211585:0:15163:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788753049.211598:0:15163:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c9b90a5a800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1788753049.211637:0:15163:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9a85e02680 x1875643182701568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788753049.211832:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875643182701568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788753049.211914:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788753049.211986:0:15163:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788753049.212067:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701568 00000100:00100000:0.0:1788753049.212075:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701568 00000100:00100000:0.0:1788753049.212106:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788753049.212113:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3302:x1875643182701568:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788753049.212155:0:14455:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1788753049.212189:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x80c8383f48490f25 00000004:00100000:0.0:1788753049.212202:0:14455:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788753049.212232:0:14455:0:(import.c:65:import_set_state_nolock()) ffff9c9bafe44000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788753049.215869:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875643182701568:12345-0@lo:38:llog_process_th.0 Request processed in 3745us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753049.215883:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788753049.216067:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9a85e02680 x1875643182701568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788753059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788753049.216078:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788753049.216087:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788753049.216095:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788753049.216100:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788753049.216104:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b90a5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788753049.216110:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3302:1875643182701568:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788753049.217230:0:15163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788753049.217383:0:15140:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788753049.217408:0:15140:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788753049.217491:0:15140:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bc2172a00/0x80c8383f48490f09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f10 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.217503:0:15140:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bc2172a00/0x80c8383f48490f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f10 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788753049.217543:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788753049.217545:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788753049.217547:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788753049.217548:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788753049.217549:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788753049.217550:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788753049.217552:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788753049.217554:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788753049.217555:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788753049.217559:0:15140:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788753049.217562:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788753049.217563:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788753049.217564:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788753049.217566:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788753049.217567:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788753049.217568:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788753049.217569:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788753049.217570:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788753049.217572:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788753049.217594:0:15140:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788753049.217613:0:15140:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788753049.218542:0:15140:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753049.218591:0:15140:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0ed5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788753049.219188:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701696 00000100:00100000:3.0:1788753049.219197:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701696 00000100:00100000:3.0:1788753049.219246:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788753049.219256:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15140:x1875643182701696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788753049.219286:0:14449:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788753049.219313:0:14449:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788753049.242688:0:14449:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788753049.242734:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788753049.243335:0:14472:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788753049.243341:0:14472:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788753049.243363:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.243383:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490e92 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.243410:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.243448:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f48490e92 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.243462:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f48490e92 expref: 16 pid: 14447 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753049.243475:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14472:1875643182701824:0@lo:104: 00000100:00100000:0.0:1788753049.243539:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753049.243617:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba00b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788753049.243735:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701824 00000100:00100000:2.0:1788753049.243742:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701824 00000100:00100000:2.0:1788753049.243895:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788753049.243906:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14472:x1875643182701824:12345-0@lo:104: 00010000:00010000:2.0:1788753049.243925:0:14439:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753049.243991:0:14439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788753049.243998:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14472:x1875643182701824:12345-0@lo:104: Request processed in 95us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.244005:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788753049.244063:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753049.244070:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244077:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4dc00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788753049.244081:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244089:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788753049.244109:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753049.244114:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788753049.244159:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244166:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788753049.244183:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244189:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4dc00/0x80c8383f48490e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490e99 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244204:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753049.244206:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753049.244208:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788753049.244219:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788753049.244229:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cf43312c-18dc-4b92-a763-9e6fba828a91:3304:1875643182701952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788753049.244258:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753049.244295:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182701952 00000100:00100000:3.0:1788753049.244300:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182701952 00010000:00010000:3.0:1788753049.244318:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490e92 expref: 17 pid: 14447 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753049.244335:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788753049.244340:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:3304:x1875643182701952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788753049.244350:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788753049.244360:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490e92 expref: 17 pid: 14447 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244369:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f48490e92 expref: 17 pid: 14447 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244384:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244392:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788753049.244405:0:14442:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001768120s 00010000:00010000:3.0:1788753049.244409:0:14442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244416:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244422:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244428:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244433:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753049.244436:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244442:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244451:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753049.244465:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788753049.244493:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:3304:x1875643182701952:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753049.244500:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788753049.244530:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cf43312c-18dc-4b92-a763-9e6fba828a91:3304:1875643182701952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788753049.244619:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bb55b0c00/0x80c8383f48490e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f48490e92 expref: 16 pid: 14447 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753049.244628:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14472:1875643182701824:0@lo:104: 00010000:00010000:0.0:1788753049.244639:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.244647:0:14472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.244664:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753049.244670:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9a85e4ce00/0x80c8383f48490f2c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753049.256890:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+15:15140:x1875643182701696:12345-0@lo:253:mount.lustre.0 Request processed in 37628us (38342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753049.256900:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788753049.257000:0:15140:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15140:1875643182701696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788753049.257037:0:15140:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788753049.257040:0:15140:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788753049.257042:0:15140:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788753049.257043:0:15140:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788753049.257044:0:15140:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788753049.257045:0:15140:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788753049.257047:0:15140:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788753049.257048:0:15140:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788753049.257050:0:15140:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788753049.257052:0:15140:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788753049.257065:0:15140:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788753049.262746:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788753049.262994:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788753049.263190:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788753049.263334:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788753049.263477:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788753049.264040:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788753049.265034:0:15140:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788753049.303998:0:15140:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788753049.304089:0:15140:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788753049.304158:0:15140:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788753049.304214:0:15140:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788753049.304232:0:15140:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788753049.304270:0:15140:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788753050.218306:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788753050.475937:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788753051.178242:0:14453:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788753051.178251:0:14453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9bbdf68000 from 7 10000000:01000000:0.0:1788753051.178256:0:14453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788753051.178304:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753051.178316:0:14453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753051.178327:0:14453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753051.178352:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182702080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788753051.178417:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753051.178478:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9246a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788753051.178543:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702080 00000100:00100000:2.0:1788753051.178551:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702080 00000100:00100000:2.0:1788753051.178608:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788753051.178618:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+15:14453:x1875643182702080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788753051.178631:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753051.178646:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490f33 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753051.178670:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490f33 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753051.178681:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490f33 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753051.178690:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1600, rc 0) 00000100:00100000:2.0:1788753051.178777:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+16:14453:x1875643182702080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753051.178784:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788753051.179311:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182702080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788753051.179326:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753051.179336:0:14453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753051.179387:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182702208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788753051.179422:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753051.179485:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9246a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788753051.179527:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702208 00000100:00100000:2.0:1788753051.179532:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702208 00000100:00100000:2.0:1788753051.179565:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788753051.179572:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:14453:x1875643182702208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788753051.179647:0:14449:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788753051.179661:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788753051.179665:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788753051.179888:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:14453:x1875643182702208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 315us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753051.179895:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788753051.179947:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182702208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788753051.180001:0:14453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788753051.180024:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753051.180032:0:14453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753051.245361:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753052.267262:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753053.291225:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788753054.050973:0:15507:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788753054.314464:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788753054.382446:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753054.382455:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788753054.382459:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753054.382462:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788753054.382656:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cf43312c-18dc-4b92-a763-9e6fba828a91:3304:1875643182702336:0@lo:400:kworker.0 00000100:00100000:3.0:1788753054.382806:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753054.382904:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182702464:0@lo:400:kworker.0 00000100:00100000:1.0:1788753054.383320:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182702592:0@lo:400:kworker.0 00000100:00100000:0.0:1788753054.383346:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702336 00000100:00100000:0.0:1788753054.383357:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702336 00000100:00100000:1.0:1788753054.383419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753054.383428:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788753054.383445:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+16:3304:x1875643182702336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788753054.383491:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702592 00000100:00100000:1.0:1788753054.383502:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702592 00000100:00100000:0.0:1788753054.383531:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+16:3304:x1875643182702336:12345-0@lo:400:kworker.0 Request processed in 90us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753054.383542:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788753054.383581:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788753054.383595:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182702592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753054.383619:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cf43312c-18dc-4b92-a763-9e6fba828a91:3304:1875643182702336:0@lo:400:kworker.0 00000100:00100000:1.0:1788753054.383773:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182702592:12345-0@lo:400:kworker.0 Request processed in 180us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753054.383783:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788753054.383832:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788753054.383877:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bb57b8380 x1875643182702592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788753054.383892:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182702592:0@lo:400:kworker.0 00000100:00100000:3.0:1788753054.385595:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753054.385737:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702464 00000100:00100000:0.0:1788753054.385748:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702464 00000100:00100000:0.0:1788753054.385855:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788753054.385867:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182702464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753054.386080:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182702464:12345-0@lo:400:kworker.0 Request processed in 214us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753054.386089:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788753054.387584:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bb57b8a80 x1875643182702464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788753054.387602:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182702464:0@lo:400:kworker.0 00010000:00010000:1.0:1788753055.347741:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753056.366826:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753057.392636:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753058.411268:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753059.442424:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788753059.498898:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753059.498908:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788753059.498911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753059.498915:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788753059.498981:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182702976:0@lo:400:kworker.0 00000100:00100000:3.0:1788753059.499073:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753059.499225:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182702848:0@lo:400:kworker.0 00000100:00100000:2.0:1788753059.499260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753059.499300:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788753059.499306:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cf43312c-18dc-4b92-a763-9e6fba828a91:3304:1875643182702720:0@lo:400:kworker.0 00000100:00100000:2.0:1788753059.499337:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753059.499375:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702720 00000100:00100000:2.0:1788753059.499383:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702720 00000100:00100000:2.0:1788753059.499442:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788753059.499451:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:3304:x1875643182702720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753059.499532:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:3304:x1875643182702720:12345-0@lo:400:kworker.0 Request processed in 81us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753059.499539:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788753059.499625:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cf43312c-18dc-4b92-a763-9e6fba828a91:3304:1875643182702720:0@lo:400:kworker.0 00000100:00100000:1.0:1788753059.499719:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702976 00000100:00100000:1.0:1788753059.499724:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702976 00000100:00100000:1.0:1788753059.499777:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182702848 00000100:00100000:1.0:1788753059.499781:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182702848 00000100:00100000:1.0:1788753059.499796:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788753059.499803:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182702976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788753059.499847:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182702976:12345-0@lo:400:kworker.0 Request processed in 45us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753059.499853:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788753059.499874:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788753059.499880:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182702848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788753059.499913:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182702848:12345-0@lo:400:kworker.0 Request processed in 34us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753059.499920:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788753059.499966:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bb57baa00 x1875643182702976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788753059.499979:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182702976:0@lo:400:kworker.0 00010000:00080000:1.0:1788753059.500011:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bb57ba300 x1875643182702848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788753059.500019:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182702848:0@lo:400:kworker.0 00000100:00080000:2.0:1788753059.500392:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:3.0:1788753060.096650:0:15857:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788753060.096654:0:15857:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788753060.096758:0:15857:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c9bbd903000 00000020:01000004:3.0:1788753060.096781:0:15857:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788753060.096793:0:15857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788753060.096818:0:15857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c9ba76619c0) 00000020:00000080:3.0:1788753060.096834:0:15857:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788753060.119775:0:15857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788753060.120033:0:15857:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788753060.120844:0:15857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788753060.121057:0:15857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788753060.121712:0:15857:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788753060.122060:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 427: rc = 0 00100000:10000000:0.0:1788753060.122276:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 427: rc = 0 00100000:10000000:0.0:1788753060.122451:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 427: rc = 0 00100000:10000000:0.0:1788753060.122817:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 299: rc = 0 00100000:10000000:0.0:1788753060.123042:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 299: rc = 0 00100000:10000000:0.0:1788753060.123472:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 299: rc = 0 00100000:10000000:0.0:1788753060.123797:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 299: rc = 0 00100000:10000000:0.0:1788753060.124033:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 299: rc = 0 00100000:10000000:0.0:1788753060.124440:0:15857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 299: rc = 0 00000020:00000080:0.0:1788753060.124991:0:15857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788753060.125005:0:15857:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788753060.125016:0:15857:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x80c8383f48490f48 00000020:01000004:0.0:1788753060.125026:0:15857:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788753060.125048:0:15857:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.105@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788753060.125051:0:15857:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788753060.125057:0:15857:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788753060.125079:0:15857:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788753060.125082:0:15857:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.105@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788753060.133688:0:15857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.105@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788753060.133725:0:15857:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.105@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788753060.133730:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788753060.133731:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788753060.133732:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788753060.133733:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788753060.133735:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788753060.133736:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788753060.133737:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788753060.133739:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788753060.133740:0:15857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788753060.133744:0:15857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788753060.133746:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788753060.133748:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788753060.133749:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788753060.133750:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788753060.133751:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788753060.133752:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788753060.133753:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788753060.133754:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788753060.133759:0:15857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788753060.134042:0:15857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788753060.134062:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703104:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788753060.134318:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753060.134495:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f606f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788753060.134542:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182703104 00000100:00100000:0.0:1788753060.134550:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182703104 00000100:00100000:0.0:1788753060.134604:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788753060.134612:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15857:x1875643182703104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788753060.134642:0:14450:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788753060.134645:0:14450:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788753060.134648:0:14450:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788753060.140253:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15857:x1875643182703104:12345-0@lo:253:mount.lustre.0 Request processed in 5631us (5925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753060.140267:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788753060.140434:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788753060.140449:0:15857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788753060.140453:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788753060.140454:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788753060.140456:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788753060.140457:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788753060.140458:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788753060.140459:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788753060.140460:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788753060.140462:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788753060.140463:0:15857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788753060.140483:0:15857:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c9bbd903000 from lustre-OST0001 10000000:01000000:2.0:1788753060.140511:0:15857:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788753060.140514:0:15857:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788753060.140522:0:15857:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c9a84163380 local copy 00010000:00010000:2.0:1788753060.140532:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753060.140822:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753060.140858:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.140937:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a879d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788753060.140991:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182703232 00000100:00100000:0.0:1788753060.140999:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182703232 00000100:00100000:0.0:1788753060.141071:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788753060.141080:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15857:x1875643182703232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788753060.141512:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15857:x1875643182703232:12345-0@lo:501:mount.lustre.0 Request processed in 431us (651us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788753060.141525:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788753060.141611:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703232:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788753060.141630:0:15857:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788753060.141782:0:15857:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.105@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788753060.141790:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.141800:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b80031600/0x80c8383f48490db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490dc0 expref: -99 pid: 14437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788753060.141823:0:15857:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c9bbd903000 10000000:01000000:1.0:1788753060.141828:0:15857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788753060.141832:0:15857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788753060.141834:0:15857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788753060.141838:0:15857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788753060.141841:0:15857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788753060.141866:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270200/0x80c8383f48490f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.141872:0:15857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270200/0x80c8383f48490f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.141890:0:15857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270200/0x80c8383f48490f4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753060.141905:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703360:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788753060.141935:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753060.142172:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f606780 going to sleep for 11 seconds 00000100:00100000:2.0:1788753060.142443:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182703360 00000100:00100000:2.0:1788753060.142449:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182703360 00000100:00100000:2.0:1788753060.142481:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788753060.142488:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+16:15857:x1875643182703360:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788753060.142499:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753060.142511:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b0600/0x80c8383f48490f56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490f4f expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753060.142545:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b0600/0x80c8383f48490f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490f4f expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753060.142555:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b0600/0x80c8383f48490f56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490f4f expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753060.142563:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0600, rc 0) 00000100:00100000:2.0:1788753060.142621:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703360:12345-0@lo:101:mount.lustre.0 Request processed in 132us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753060.142627:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788753060.142764:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703360:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753060.142779:0:15857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270200/0x80c8383f48490f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f56 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.142787:0:15857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270200/0x80c8383f48490f4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490f56 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788753060.143410:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788753060.144569:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788753060.144900:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788753060.144945:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788753060.144993:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788753060.145036:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788753060.145086:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788753060.145119:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788753060.145420:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788753060.145428:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788753060.145507:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788753060.145568:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753060.145717:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f606a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788753060.145774:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182703488 00000100:00100000:2.0:1788753060.145781:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182703488 00000100:00100000:2.0:1788753060.145813:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788753060.145820:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703488:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753060.146293:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe212050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703488:12345-0@lo:501:mount.lustre.0 Request processed in 471us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753060.146300:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788753060.146829:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703488:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788753060.146889:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703616:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788753060.146931:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753060.146965:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f606a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788753060.147026:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182703616 00000100:00100000:0.0:1788753060.147031:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182703616 00000100:00100000:0.0:1788753060.147063:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788753060.147069:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788753060.147696:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe213050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703616:12345-0@lo:503:mount.lustre.0 Request processed in 512us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753060.147705:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788753060.147804:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788753060.148557:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788753060.148775:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788753060.148834:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753060.148903:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788753060.149349:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182703744 00000100:00100000:3.0:1788753060.149365:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182703744 00000100:00100000:2.0:1788753060.149498:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788753060.149509:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753060.149864:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe211c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703744:12345-0@lo:502:mount.lustre.0 Request processed in 356us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753060.149872:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788753060.149990:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788753060.150496:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788753060.150546:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788753060.150571:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788753060.150692:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788753060.150731:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788753060.150765:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788753060.150813:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788753060.150845:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788753060.150882:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788753060.150917:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788753060.150984:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753060.151012:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788753060.151571:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182703872 00000100:00100000:2.0:1788753060.151578:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182703872 00000100:00100000:2.0:1788753060.151724:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788753060.151733:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753060.151970:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe210850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182703872:12345-0@lo:502:mount.lustre.0 Request processed in 237us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753060.151977:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788753060.152290:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182703872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788753060.152462:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788753060.152474:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788753060.153831:0:15858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788753060.153842:0:15858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788753060.153848:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788753060.153850:0:15858:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788753060.153855:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788753060.153869:0:15858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c9ba7663380) 00000020:00000080:3.0:1788753060.153891:0:15858:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788753060.153896:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788753060.153973:0:15858:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bbd903000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788753060.153980:0:15858:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788753060.153986:0:15858:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x80c8383f48490f64 00010000:00010000:3.0:1788753060.162855:0:15858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788753060.163730:0:15858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788753060.172021:0:15858:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788753060.177048:0:15858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788753060.177061:0:15858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753060.177067:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.177069:0:15858:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788753060.177073:0:15858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753060.177077:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.177079:0:15858:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788753060.177081:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788753060.177083:0:15858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788753060.177085:0:15858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753060.177087:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.177088:0:15858:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788753060.177091:0:15858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753060.177093:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.177094:0:15858:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788753060.177097:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788753060.179248:0:15858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753060.179259:0:15858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.179262:0:15858:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788753060.179268:0:15858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788753060.180168:0:15857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788753060.180210:0:15857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788753060.180235:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270200/0x80c8383f48490f4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f56 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.180248:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bbe270200/0x80c8383f48490f4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f56 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788753060.180257:0:15857:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbd903000 from 1 10000000:01000000:0.0:1788753060.180260:0:15857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788753060.180301:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.180309:0:15857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.180335:0:15857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753060.180371:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788753060.180440:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753060.180480:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788753060.181888:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704000 00000100:00100000:3.0:1788753060.181903:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704000 00000100:00100000:3.0:1788753060.181981:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788753060.181992:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:15857:x1875643182704000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788753060.182011:0:14450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753060.182029:0:14450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490f6b expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.182054:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490f6b expref: 18 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.182066:0:14450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490f6b expref: 18 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.182091:0:14450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173200, rc 0) 00000100:00100000:3.0:1788753060.182193:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe210c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704000:12345-0@lo:101:mount.lustre.0 Request processed in 203us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753060.182200:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788753060.182351:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788753060.182380:0:15857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.182389:0:15857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788753060.183105:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788753060.189794:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788753060.190071:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788753060.190150:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788753060.190219:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788753060.190228:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788753060.190327:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753060.191649:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.191731:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91fea000 going to sleep for 11 seconds 00000100:00100000:1.0:1788753060.191924:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704128 00000100:00100000:1.0:1788753060.191932:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704128 00000100:00100000:1.0:1788753060.191999:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788753060.192009:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788753060.192785:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe213850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704128:12345-0@lo:501:mount.lustre.0 Request processed in 776us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753060.192793:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788753060.192861:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753060.192908:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753060.192963:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.193036:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91fea000 going to sleep for 11 seconds 00000100:00100000:0.0:1788753060.193072:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704256 00000100:00100000:0.0:1788753060.193077:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704256 00000100:00100000:0.0:1788753060.193278:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788753060.193288:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788753060.193606:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe213c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704256:12345-0@lo:503:mount.lustre.0 Request processed in 319us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753060.193613:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788753060.193682:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788753060.194197:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788753060.194269:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753060.194315:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.197239:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91fea000 going to sleep for 11 seconds 00000100:00100000:3.0:1788753060.197968:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704384 00000100:00100000:3.0:1788753060.197980:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704384 00000100:00100000:3.0:1788753060.198037:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788753060.198047:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788753060.198534:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe211850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704384:12345-0@lo:502:mount.lustre.0 Request processed in 487us (4216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753060.198543:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788753060.198670:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788753060.199011:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788753060.199058:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788753060.199145:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788753060.199188:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788753060.199371:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788753060.199465:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788753060.199493:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788753060.199517:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788753060.199555:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753060.200055:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.200094:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91fea000 going to sleep for 11 seconds 00000100:00100000:3.0:1788753060.200330:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704512 00000100:00100000:3.0:1788753060.200340:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704512 00000100:00100000:3.0:1788753060.200377:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788753060.200386:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788753060.201991:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788753060.202269:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704512:12345-0@lo:502:mount.lustre.0 Request processed in 1881us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753060.202281:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000040:00080000:1.0:1788753060.202656:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788753060.202675:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788753060.204035:0:15862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753060.204046:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.204049:0:15862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788753060.204056:0:15862:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bbd903000 00000020:00000080:2.0:1788753060.204059:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788753060.204067:0:15862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753060.204077:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.204078:0:15862:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788753060.204082:0:15862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753060.204084:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.204085:0:15862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788753060.204088:0:15862:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c9bbd903000 00000020:00000080:2.0:1788753060.204091:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788753060.206334:0:15862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753060.206342:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.206344:0:15862:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788753060.206348:0:15862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788753060.206351:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.206353:0:15862:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788753060.206357:0:15862:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c9bbd903000 00000020:00000080:2.0:1788753060.206359:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788753060.206472:0:15862:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788753060.206476:0:15862:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788753060.206477:0:15862:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788753060.206481:0:15862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788753060.206843:0:15857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788753060.206872:0:15857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788753060.206894:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.206908:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788753060.206971:0:15857:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788753060.206974:0:15857:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c9bbd903000 10000000:01000000:0.0:1788753060.206976:0:15857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c9bbd903000 10000000:01000000:0.0:1788753060.206980:0:15857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788753060.206985:0:15857:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c9bbd903000 from 1 10000000:01000000:0.0:1788753060.206988:0:15857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788753060.207019:0:15857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d800/0x80c8383f48490f79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.207028:0:15857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d800/0x80c8383f48490f79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.207038:0:15857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d800/0x80c8383f48490f79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753060.207081:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788753060.207713:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753060.207821:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788753060.207872:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704640 00000100:00100000:1.0:1788753060.207880:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704640 00000100:00100000:1.0:1788753060.207926:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788753060.207935:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182704640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788753060.207959:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753060.207972:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe271000/0x80c8383f48490f80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490f79 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.207994:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe271000/0x80c8383f48490f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490f79 expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.208016:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe271000/0x80c8383f48490f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490f79 expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.208025:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe271000, rc 0) 00000100:00100000:1.0:1788753060.208080:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182704640:12345-0@lo:101:mount.lustre.0 Request processed in 146us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753060.208087:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788753060.208818:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788753060.208838:0:15857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d800/0x80c8383f48490f79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f80 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753060.208848:0:15857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d800/0x80c8383f48490f79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490f80 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788753060.209749:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788753060.210063:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788753060.210465:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788753060.210512:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788753060.210545:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788753060.210708:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788753060.210761:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788753060.210814:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788753060.210850:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788753060.210884:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788753060.210934:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788753060.210984:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788753060.211018:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788753060.211066:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788753060.211103:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788753060.211175:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788753060.211352:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788753060.211391:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788753060.211423:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788753060.211469:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788753060.211502:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788753060.211534:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788753060.211642:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788753060.211687:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788753060.211723:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788753060.211773:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788753060.211811:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788753060.211846:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788753060.211895:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788753060.211932:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788753060.211982:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788753060.212051:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788753060.212090:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788753060.212149:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788753060.212189:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788753060.214741:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788753060.214857:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788753060.214932:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788753060.214984:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788753060.215092:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788753060.215101:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788753060.215210:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753060.215291:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.215341:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704768 00000100:00100000:2.0:1788753060.215348:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704768 00000100:00100000:2.0:1788753060.215392:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788753060.215400:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182704768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753060.216283:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182704768:12345-0@lo:501:mount.lustre.0 Request processed in 880us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753060.216293:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788753060.216348:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91fea000 going to sleep for 11 seconds 00000100:00100000:2.0:1788753060.216371:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788753060.216411:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788753060.216454:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.216477:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91fea000 going to sleep for 11 seconds 00000100:00100000:1.0:1788753060.225452:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182704896 00000100:00100000:1.0:1788753060.225468:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182704896 00000100:00100000:1.0:1788753060.225532:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788753060.225543:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182704896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788753060.228549:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182704896:12345-0@lo:503:mount.lustre.0 Request processed in 3000us (12087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753060.228562:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788753060.229732:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182704896:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788753060.231298:0:15857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788753060.231382:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182705024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788753060.231455:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753060.231497:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f606a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788753060.232000:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705024 00000100:00100000:2.0:1788753060.232008:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705024 00000100:00100000:2.0:1788753060.232048:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788753060.232058:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baf1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182705024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788753060.233542:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baf1afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182705024:12345-0@lo:502:mount.lustre.0 Request processed in 1481us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753060.233554:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788753060.234024:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e03100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182705024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788753060.234414:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788753060.234476:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788753060.234514:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788753060.234564:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788753060.234680:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788753060.234732:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788753060.234981:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788753060.235018:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788753060.235067:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788753060.235101:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788753060.235414:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788753060.235471:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788753060.235507:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788753060.235541:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788753060.236506:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788753060.236563:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788753060.236672:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788753060.236729:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788753060.236876:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788753060.236911:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788753060.236999:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788753060.237040:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788753060.237096:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788753060.237369:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788753060.237408:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788753060.237455:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788753060.237500:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788753060.237537:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788753060.237570:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788753060.237695:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788753060.237726:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788753060.237837:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788753060.237872:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788753060.237920:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788753060.237967:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788753060.238015:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788753060.238049:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788753060.238082:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788753060.238439:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788753060.238479:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788753060.238527:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182705152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788753060.238832:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753060.238879:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788753060.239330:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705152 00000100:00100000:1.0:1788753060.239338:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705152 00000100:00100000:1.0:1788753060.239382:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788753060.239391:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182705152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788753060.240281:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182705152:12345-0@lo:502:mount.lustre.0 Request processed in 882us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753060.240299:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788753060.240425:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182705152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788753060.240543:0:15857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788753060.240556:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788753060.241964:0:15867:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788753060.241979:0:15867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c9ba7664d40) 00000020:00000080:3.0:1788753060.242004:0:15867:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788753060.242073:0:15867:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c9bbd903000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788753060.242078:0:15867:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c9bbd903000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788753060.242080:0:15867:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c9bbd903000 3 00010000:00080000:3.0:1788753060.242110:0:15867:0:(ldlm_lib.c:103:import_set_conn()) imp ffff9c9b90a5c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.105@tcp at head 00010000:00010000:3.0:1788753060.244690:0:15867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788753060.245043:0:15867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788753060.245081:0:15867:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788753060.245095:0:15867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x80c8383f48490f8e 00000100:00080000:3.0:1788753060.245105:0:15867:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788753060.245116:0:15867:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c9b90a5c000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:3.0:1788753060.245185:0:15867:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bb57b9880 x1875643182705280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788753060.245214:0:15867:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788753060.245244:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753060.245249:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788753060.245252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788753060.245255:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788753060.245524:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875643182705280:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788753060.245603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753060.245661:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705280 00000100:00100000:1.0:1788753060.245668:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705280 00000100:00100000:1.0:1788753060.245699:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788753060.245706:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3302:x1875643182705280:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788753060.245729:0:14456:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1788753060.245890:0:14456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x80c8383f48490f95 00000004:00100000:1.0:1788753060.245905:0:14456:0:(mdt_handler.c:7495:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788753060.245934:0:14456:0:(import.c:65:import_set_state_nolock()) ffff9c9b92b51000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788753060.246009:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875643182705280:12345-0@lo:38:llog_process_th.0 Request processed in 301us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753060.246016:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788753060.246172:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c9bb57b9880 x1875643182705280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788753070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788753060.246184:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788753060.246192:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788753060.246199:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788753060.246203:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788753060.246205:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9b90a5c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788753060.246211:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3302:1875643182705280:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788753060.246358:0:15867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788753060.246815:0:15857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788753060.246848:0:15857:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788753060.246874:0:15857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d800/0x80c8383f48490f79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f80 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753060.246888:0:15857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d800/0x80c8383f48490f79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490f80 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788753060.246944:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788753060.246958:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788753060.246959:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788753060.246961:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788753060.246962:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788753060.246964:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788753060.246971:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788753060.246974:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788753060.246975:0:15857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788753060.246978:0:15857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788753060.246981:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788753060.246982:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788753060.246983:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788753060.246984:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788753060.246985:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788753060.246986:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788753060.246987:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788753060.246988:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788753060.246989:0:15857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788753060.247009:0:15857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788753060.247023:0:15857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182705408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788753060.247083:0:15857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753060.247112:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705408 00000100:00100000:1.0:1788753060.247114:0:15857:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b8f606a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788753060.247119:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705408 00000100:00100000:2.0:1788753060.247169:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788753060.247176:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+19:15857:x1875643182705408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788753060.247212:0:14450:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788753060.247227:0:14450:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788753060.298213:0:14450:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788753060.298236:0:14450:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788753060.298305:0:14472:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788753060.298312:0:14472:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788753060.298340:0:14472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.298357:0:14472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490f33 expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.298365:0:14472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.298416:0:14472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f48490f33 expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753060.298432:0:14472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f48490f33 expref: 19 pid: 14447 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753060.298450:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14472:1875643182705536:0@lo:104: 00000100:00100000:0.0:1788753060.298509:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753060.298553:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788753060.298783:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705536 00000100:00100000:3.0:1788753060.298790:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705536 00000100:00100000:3.0:1788753060.298845:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788753060.298854:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14472:x1875643182705536:12345-0@lo:104: 00010000:00010000:3.0:1788753060.298867:0:14439:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.298926:0:14439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788753060.298932:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cf43312c-18dc-4b92-a763-9e6fba828a91+3:14472:x1875643182705536:12345-0@lo:104: Request processed in 80us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753060.298939:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788753060.298989:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14472:1875643182705536:0@lo:104: 00010000:00010000:3.0:1788753060.299008:0:14472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303193:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753060.303208:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303220:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:3.0:1788753060.303224:0:14444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303234:0:14444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788753060.303241:0:14444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788753060.303246:0:14444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788753060.303305:0:14444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303327:0:14444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788753060.303355:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303361:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ce00/0x80c8383f48490f33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f3a expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303382:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753060.303383:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753060.303385:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788753060.303403:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182705664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788753060.303465:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753060.303530:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705664 00000100:00100000:3.0:1788753060.303537:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705664 00010000:00010000:3.0:1788753060.303567:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490f33 expref: 20 pid: 14447 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753060.303610:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788753060.303619:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+20:3306:x1875643182705664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788753060.303632:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788753060.303638:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490f33 expref: 20 pid: 14447 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303648:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f48490f33 expref: 20 pid: 14447 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303661:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bb55b1600/0x80c8383f48490f3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f48490f33 expref: 20 pid: 14447 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303685:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303694:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788753060.303709:0:14442:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005397752s 00010000:00010000:3.0:1788753060.303714:0:14442:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303722:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303729:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303736:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303741:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753060.303745:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303752:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303767:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303776:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788753060.303816:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57ba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3306:x1875643182705664:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753060.303824:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788753060.303866:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182705664:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788753060.303889:0:14472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303896:0:14472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753060.303902:0:14472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9a85e4c400/0x80c8383f48490f9c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753060.318973:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:15857:x1875643182705408:12345-0@lo:253:mount.lustre.0 Request processed in 71788us (71881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753060.318988:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788753060.319110:0:15857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cf43312c-18dc-4b92-a763-9e6fba828a91:15857:1875643182705408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788753060.319147:0:15857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788753060.319150:0:15857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788753060.319152:0:15857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788753060.319153:0:15857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788753060.319154:0:15857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788753060.319156:0:15857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788753060.319157:0:15857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788753060.319158:0:15857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788753060.319160:0:15857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788753060.319162:0:15857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788753060.319177:0:15857:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788753060.324672:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788753060.324976:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788753060.325226:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788753060.325392:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788753060.325540:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788753060.325926:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788753060.327241:0:15857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788753060.404407:0:15857:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788753060.404417:0:15857:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788753060.404455:0:15857:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788753060.404511:0:15857:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.105@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788753060.404526:0:15857:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788753060.404552:0:15857:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788753060.458232:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788753060.717080:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788753061.484201:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788753061.610201:0:14453:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788753061.610209:0:14453:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c9bbdf68000 from 8 10000000:01000000:0.0:1788753061.610214:0:14453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788753061.610260:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d600/0x80c8383f48490fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753061.610272:0:14453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d600/0x80c8383f48490fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753061.610283:0:14453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d600/0x80c8383f48490fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753061.610320:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182705792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788753061.610386:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753061.610439:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9180e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788753061.610493:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705792 00000100:00100000:1.0:1788753061.610506:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705792 00000100:00100000:1.0:1788753061.611236:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788753061.611247:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+18:14453:x1875643182705792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788753061.611261:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753061.611276:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bbe270c00/0x80c8383f48490faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f48490fa3 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753061.611299:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bbe270c00/0x80c8383f48490faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f48490fa3 expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753061.611312:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bbe270c00/0x80c8383f48490faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490fa3 expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753061.611322:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bbe270c00, rc 0) 00000100:00100000:1.0:1788753061.611380:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182705792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753061.611387:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788753061.611410:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182705792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788753061.611428:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d600/0x80c8383f48490fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490faa expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753061.611438:0:14453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d600/0x80c8383f48490fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f48490faa expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753061.611494:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182705920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788753061.611533:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753061.611566:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45600 going to sleep for 11 seconds 00000100:00100000:2.0:1788753061.611798:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182705920 00000100:00100000:2.0:1788753061.611804:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182705920 00000100:00100000:2.0:1788753061.611833:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788753061.611840:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182705920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788753061.611855:0:14450:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788753061.611871:0:14450:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788753061.611874:0:14450:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788753061.611973:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182705920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753061.611981:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788753061.611984:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182705920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788753061.612357:0:14453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788753061.612367:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d600/0x80c8383f48490fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490faa expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753061.612376:0:14453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d600/0x80c8383f48490fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f48490faa expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753062.506302:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788753063.338270:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788753048/real 1788753048] req@ffff9c9bb57b9f80 x1875643182698880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753063.338302:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c9bb57b9f80 x1875643182698880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753063.338312:0:3302:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788753048/real 1788753048] req@ffff9c9bb57b8000 x1875643182699008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753063 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753063.338325:0:3302:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c9bb57b8000 x1875643182699008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788753063 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788753063.338354:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe571800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788753063.338376:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788753063.338379:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182698880:0@lo:8:kworker.0 00000100:00080000:0.0:1788753063.338385:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe572000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788753063.338390:0:3302:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788753063.338392:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182699008:0@lo:8:kworker.0 00000100:00080000:2.0:1788753063.338807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788753063.338812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788753063.338815:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe571800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788753063.338820:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:2.0:1788753063.338825:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788753063.338836:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c9bbe571800 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1788753063.338836:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182706048:0@lo:400:kworker.0 00000100:00100000:2.0:1788753063.338856:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bbde9ed80 x1875643182706176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788753063.338872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788753063.338876:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788753063.338877:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe572000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788753063.338880:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:2.0:1788753063.338882:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788753063.338886:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c9bbe572000 using connection 192.168.203.105@tcp/0@lo 00000100:00100000:1.0:1788753063.338898:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753063.338910:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c9bbde9ca80 x1875643182706304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788753063.338955:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788753063.338961:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182706432:0@lo:400:kworker.0 00000100:00100000:2.0:1788753063.338974:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182706560:0@lo:400:kworker.0 00000100:00100000:0.0:1788753063.338988:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706048 00000100:00100000:1.0:1788753063.338996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753063.338997:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706048 00000100:00100000:2.0:1788753063.339008:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182706688:0@lo:400:kworker.0 00000100:00100000:1.0:1788753063.339030:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706432 00000100:00100000:2.0:1788753063.339035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753063.339035:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706432 00000100:00100000:0.0:1788753063.339051:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788753063.339075:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706688 00000100:00100000:1.0:1788753063.339080:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706688 00000100:00100000:2.0:1788753063.339081:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788753063.339114:0:14457:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788753063.339141:0:14457:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788753063.339162:0:14455:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788753063.339179:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788753063.339213:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3303:x1875643182706048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753063.339271:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3303:x1875643182706048:12345-0@lo:400:kworker.0 Request processed in 211us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753063.339285:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788753063.339642:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788753063.340676:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753063.340845:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182706176:0@lo:8:kworker.0 00000100:00100000:2.0:1788753063.340939:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182706432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753063.340991:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182706432:12345-0@lo:400:kworker.0 Request processed in 1904us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753063.341000:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788753063.341017:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753063.341023:0:14456:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788753063.341034:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706560 00000100:00100000:2.0:1788753063.341040:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706560 00000100:00100000:3.0:1788753063.341057:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182706304:0@lo:8:kworker.0 00000100:00100000:2.0:1788753063.341070:0:14456:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788753063.341080:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788753063.341089:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182706560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788753063.341113:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182706688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788753063.341161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753063.341894:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875643182706560:12345-0@lo:400:kworker.0 Request processed in 806us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753063.341902:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788753063.341952:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706176 00000100:00100000:2.0:1788753063.341957:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706176 00000100:00100000:2.0:1788753063.341977:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706304 00000100:00100000:2.0:1788753063.341979:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706304 00000100:00100000:2.0:1788753063.341990:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788753063.341995:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1875643182706176:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788753063.342018:0:15143:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1788753063.342057:0:15143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f48490fb1 00002000:00100000:2.0:1788753063.342070:0:15143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c9bb5b9f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788753063.342074:0:15143:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788753063.342077:0:15143:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788753063.342606:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182706688:12345-0@lo:400:kworker.0 Request processed in 3418us (3568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753063.342613:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788753063.342656:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbde9d500 x1875643182706688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788753063.342731:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182706688:0@lo:400:kworker.0 00002000:00080000:2.0:1788753063.343087:0:15143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788753063.343112:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5b9c800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1788753063.343178:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbde9dc00 x1875643182706432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788753063.343190:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182706432:0@lo:400:kworker.0 00000100:00100000:2.0:1788753063.343268:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875643182706176:12345-0@lo:8:kworker.0 Request processed in 1270us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753063.343275:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788753063.343294:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788753063.343299:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3302:x1875643182706304:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788753063.343320:0:15143:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1788753063.343345:0:15143:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x80c8383f48490fb8 00002000:00100000:2.0:1788753063.343355:0:15143:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c9bb5b9d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a2b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788753063.343359:0:15143:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788753063.343361:0:15143:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788753063.343960:0:15143:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788753063.343979:0:15143:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5b98000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788753063.344024:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1875643182706304:12345-0@lo:8:kworker.0 Request processed in 723us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753063.344030:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788753063.344072:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbde9ed80 x1875643182706176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788753083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788753063.344080:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788753063.344087:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788753063.344410:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788753063.344425:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788753063.344428:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe571800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788753063.345621:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788753063.345633:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182706176:0@lo:8:kworker.0 00010000:00080000:2.0:1788753063.345665:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbde9ca80 x1875643182706304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788753083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788753063.345675:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788753063.345682:0:3302:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788753063.345689:0:3302:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788753063.345693:0:3302:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788753063.345695:0:3302:0:(import.c:65:import_set_state_nolock()) ffff9c9bbe572000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788753063.346165:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182706048:0@lo:400:kworker.0 00000004:00080000:1.0:1788753063.346204:0:14478:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788753063.346560:0:14478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 463080435910ns, next at 0ns, rc = 0 00000004:00080000:2.0:1788753063.346802:0:3302:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788753063.346818:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3302:1875643182706304:0@lo:8:kworker.0 00000004:00080000:2.0:1788753063.346961:0:14479:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788753063.346987:0:14479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14479:1875643182706944:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788753063.347045:0:14479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753063.347086:0:14479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91432b40 going to sleep for 11 seconds 00000004:00080000:2.0:1788753063.347101:0:14480:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788753063.347369:0:14480:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 463081245091ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788753063.347382:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788753063.347391:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182706816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788753063.347419:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753063.347452:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706944 00000100:00100000:2.0:1788753063.347458:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706944 00000100:00100000:2.0:1788753063.347504:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788753063.347513:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14479:x1875643182706944:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788753063.351048:0:14481:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788753063.351074:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14481:1875643182707200:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788753063.351152:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753063.351180:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081a480 going to sleep for 11 seconds 00000100:00080000:1.0:1788753063.351220:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788753063.351247:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182706816 00000100:00100000:1.0:1788753063.351254:0:15145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182706816 00000100:00100000:1.0:1788753063.351304:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788753063.351313:0:15146:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788753063.351315:0:15145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875643182706816:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788753063.351325:0:15146:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788753063.351569:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788753063.351619:0:15145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875643182706816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753063.351626:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788753063.351670:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbde9c000 x1875643182706560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788753079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788753063.351697:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3305:1875643182706560:0@lo:400:kworker.0 00000100:00100000:1.0:1788753063.351722:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788753063.351731:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182707072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788753063.351759:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753063.351783:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707072 00000100:00100000:1.0:1788753063.351787:0:15145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707072 00000100:00100000:1.0:1788753063.351815:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788753063.351835:0:15145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182707072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788753063.351853:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788753063.351888:0:15145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1875643182707072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753063.351895:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788753063.351911:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788753063.351939:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9a85e00700 x1875643182707072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788753079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788753063.351963:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182707072:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788753063.352215:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c9bbde9ca80 x1875643182706816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788753079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788753063.352231:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182706816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788753063.352254:0:15144:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788753063.352260:0:15144:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788753063.352770:0:15143:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788753063.352780:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707200 00000100:00100000:2.0:1788753063.352786:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707200 00002000:00080000:0.0:1788753063.357158:0:15141:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788753063.357170:0:15141:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788753063.357176:0:15141:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:1.0:1788753063.359183:0:16038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788753063.359201:0:16038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14481:x1875643182707200:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788753063.367210:0:16038:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788753063.367224:0:16038:0:(ofd_dev.c:1642:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788753063.367231:0:16038:0:(ofd_dev.c:1493:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788753063.371527:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.371713:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.371855:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.371860:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.371867:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.371885:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.371896:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.372082:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.372244:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788753063.372252:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753063.372261:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.372271:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753063.372276:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.372285:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.372306:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.372335:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48490fbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.372357:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.372359:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.372361:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.374488:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.374503:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374518:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.374523:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.374529:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374553:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374567:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374575:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374593:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.374605:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.374610:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374618:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4de00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.374629:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374639:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374654:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374662:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f48490fc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.374677:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.374679:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.374681:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.379959:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.380021:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380039:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.380044:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.380281:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380298:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380310:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380326:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380345:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.380359:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.380365:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380373:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.380377:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380387:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380404:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380412:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.380637:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.380640:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.380642:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.381527:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.381535:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.381557:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.381630:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.381636:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.381651:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.381660:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.381668:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.381688:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.381692:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.382228:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382239:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270a00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.382243:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382253:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382272:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382279:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000859428f1/0x80c8383f48490fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382302:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.382304:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.382306:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.382325:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.382331:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382339:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.382342:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.382346:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382367:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382375:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382381:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382395:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.382403:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.382407:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382414:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.382417:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.382425:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.383048:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.383059:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48490fdb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788753063.383832:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.383840:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.383850:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.383854:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.383859:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.383870:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.383890:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.383898:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.384002:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788753063.384179:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788753063.384185:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.384192:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.384197:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.384206:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.384222:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.384229:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac1cd95a/0x80c8383f48490fe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.384243:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.384245:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.384251:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.384309:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.384312:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.384313:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.385619:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.385628:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385641:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.385645:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.385650:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385661:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385671:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385678:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385694:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.385703:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.385707:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385725:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.385730:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385740:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385754:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385761:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f48490fe9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788753063.385770:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.385774:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.385775:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.385776:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.385777:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.385784:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.385786:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.385790:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.385799:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.385807:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.385815:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.385843:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788753063.386387:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.386394:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.386403:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.386406:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.386410:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.386420:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.386429:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.386436:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.386449:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788753063.386894:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.386900:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.386936:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788753063.386943:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.386951:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.386955:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.386964:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.386984:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.386986:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.386992:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2d3b44e/0x80c8383f48490ff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.386993:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.386998:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387007:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387008:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.387011:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387016:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387018:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe270800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.387021:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387024:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387030:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387032:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.387038:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387045:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000292eafa3/0x80c8383f48490ff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387056:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.387059:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387160:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.387163:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387172:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387183:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387190:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000198c29fd/0x80c8383f48490ffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387203:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.387205:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.387207:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.387213:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.387427:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.387433:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387440:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.387443:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.387447:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387455:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387464:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387477:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.387498:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.387501:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.387506:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387513:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.387516:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387535:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387545:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387553:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009960451b/0x80c8383f48491005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387564:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.387566:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.387567:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.387659:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.387664:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387672:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.387675:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.387679:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387688:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387695:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387706:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387718:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.387726:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.387730:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387737:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4de00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.387740:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387747:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387758:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387765:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849100c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.387777:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.387779:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.387780:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.388279:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.388285:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.388294:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.388297:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.388301:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.388310:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.388317:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.388325:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.388343:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.389256:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.389271:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389280:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.389285:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389294:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389311:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389318:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4e47aa1/0x80c8383f48491013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389334:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.389335:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.389337:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.389526:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.389532:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389542:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.389546:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.389550:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389575:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389583:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389591:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389605:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.389614:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.389618:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389625:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4dc00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.389628:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389636:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389646:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389653:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849101a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.389672:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.389674:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.389675:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.389714:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.389792:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.389805:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.389809:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.389813:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.389822:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.389830:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.389836:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.389855:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788753063.390447:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.390453:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.390462:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.390466:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.390469:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.390479:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.390497:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.390504:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.390901:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.390908:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.390916:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.390920:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.390938:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.390952:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.390958:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.390974:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.390976:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.390977:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.392313:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.392322:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392346:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.392350:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.392355:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392369:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392378:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392385:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392401:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.392412:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.392417:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392423:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.392427:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392436:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392463:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392471:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f4849102f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392487:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.392489:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.392492:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.392938:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.392945:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392952:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.392955:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.392959:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392968:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392976:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.392983:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.393006:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.393015:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.393019:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.393024:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.393028:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.393035:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.393045:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.393052:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f48491036 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.393063:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.393064:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.393066:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.394884:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788753063.395696:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.395705:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.395789:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.395796:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.395802:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.395817:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.395827:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.395833:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.395854:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788753063.396245:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788753063.396253:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396263:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.396267:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396276:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396292:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396300:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491028 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396318:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788753063.396322:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396328:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.396332:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396339:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396356:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396362:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f4849103d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.396374:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.396375:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.396377:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788753063.397342:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788753063.397352:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397365:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=463s v=(0 0) 00010000:00010000:2.0:1788753063.397369:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753063.397374:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397387:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397397:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397405:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397437:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788753063.397450:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788753063.397455:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397462:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.397466:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397475:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397488:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.397496:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b85f171f/0x80c8383f48491044 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.398322:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.398976:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.398981:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.398983:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.400106:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.400118:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400153:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.400158:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.400164:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400177:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400188:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400196:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400216:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788753063.400712:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.400790:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.400799:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.400820:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.400825:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.400835:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.400855:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400857:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.400875:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f4849104b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400878:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.400890:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.400895:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.400895:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.400899:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.400903:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.400910:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400920:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400937:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.400952:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788753063.401318:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.401324:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.401332:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.401334:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.401338:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.401346:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.401355:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.401366:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.401670:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788753063.401806:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788753063.401813:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.401822:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9a00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.401827:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.401836:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402011:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402019:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039834e13/0x80c8383f48491052 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402039:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.402043:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402051:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.402055:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402294:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402309:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402316:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093815660/0x80c8383f48491059 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402389:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.402392:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.402398:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.402405:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.402415:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.402419:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.402424:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.402434:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.402443:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.402451:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.402459:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.402564:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.402568:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402575:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.402579:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402585:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402595:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402601:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402612:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.402614:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.402616:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.402804:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.402811:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402820:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.402825:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.402829:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402852:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402860:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402867:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402881:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.402889:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.402892:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402898:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.402901:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402908:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402919:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402939:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491067 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.402960:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.402962:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.402963:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.403182:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.403793:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.403802:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.403819:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.403823:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.403828:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.403839:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.403848:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.403855:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.403878:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.403894:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.403902:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.403910:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.403915:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.403924:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.403949:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.403957:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f4849106e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.403971:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.403973:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.403975:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.404305:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.404311:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.404330:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.404333:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.404337:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.404356:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.404364:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.404372:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.404392:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788753063.404654:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753063.404661:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.404670:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753063.404674:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.404684:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.404698:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.404705:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491075 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.404723:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.404725:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.404734:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.405275:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.405281:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405290:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.405294:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.405298:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405309:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405328:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405335:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405358:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.405368:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.405373:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405379:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4d000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.405383:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405391:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405572:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405580:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f4849107c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.405595:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.405604:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.405606:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.405892:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.405900:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788753063.406047:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.406053:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406062:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.406178:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.406182:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.406186:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.406198:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406219:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.406220:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406228:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.406232:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406248:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.406258:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.406260:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406269:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.406271:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.406278:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.406287:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.406292:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.406302:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406306:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.406315:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406316:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.406328:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f48491083 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.406345:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.406352:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.406353:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.406979:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.406983:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.406985:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.406990:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.406999:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ca00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.407003:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407022:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407034:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407041:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f4849108a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407057:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.407059:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.407061:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.407485:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.407493:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.407503:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.407520:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.407525:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788753063.407700:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.407707:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407716:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.407719:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.407723:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407733:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407742:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407757:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.407777:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.407976:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.407987:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.407996:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408009:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.408015:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408022:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4d400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.408026:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408044:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408059:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408067:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dde67b18/0x80c8383f48491098 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408083:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.408085:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.408095:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.408107:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788753063.408644:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.408651:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408661:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.408664:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.408669:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408680:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408688:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408696:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408711:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788753063.408720:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788753063.408725:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408739:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.408743:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408752:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408765:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408773:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001989300e/0x80c8383f48491091 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408789:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.408792:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408798:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.408801:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408808:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408817:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408831:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849109f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.408843:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.408845:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.408846:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.408886:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.408893:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408911:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.408915:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.408920:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408940:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408950:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408965:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.408980:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.408989:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.408993:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409001:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9e00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.409004:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409013:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409024:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409032:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f484910a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409048:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.409050:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.409053:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.409059:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.409496:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.409503:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409524:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.409528:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.409795:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409809:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409819:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409828:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.409849:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.409857:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.409864:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.409872:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.409877:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.409886:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.409901:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.409908:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ff66b2d/0x80c8383f484910ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.409940:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.409943:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.409945:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.410017:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.410025:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410033:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.410037:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.410041:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410052:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410060:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410227:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410246:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.410252:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.410259:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410268:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.410271:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410290:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410302:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410308:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003526b94d/0x80c8383f484910b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410328:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.410330:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.410332:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.410803:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.410811:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410820:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.410824:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.410829:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410840:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410849:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788753063.410852:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.410859:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410874:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410875:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.410883:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.410893:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410916:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410937:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.410945:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.410979:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788753063.410985:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788753063.410996:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788753063.411001:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411008:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.411012:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411021:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411033:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411041:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cdeab26/0x80c8383f484910bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411214:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.411219:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411227:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4dc00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.411229:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411236:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411248:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411255:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f484910c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411273:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.411276:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.411278:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.411880:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.411889:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.411898:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.411903:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1788753063.411950:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.411956:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411964:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.411974:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.411979:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.411995:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.411995:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412020:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.412020:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.412041:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412043:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412063:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.412235:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788753063.412241:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788753063.412250:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788753063.412255:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.412257:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412261:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.412267:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4de00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.412274:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412281:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.412291:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.412291:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412314:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.412319:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412326:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412341:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039db4450/0x80c8383f484910c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.412358:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.412359:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.412361:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.412366:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.412519:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f484910d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.412540:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.412542:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.412544:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788753063.412651:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788753063.412671:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788753063.413260:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.413267:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.413277:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.413281:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.413286:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.413297:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.413306:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.413314:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.413333:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.413338:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.413344:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413353:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.413357:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413367:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413386:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413394:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054cfe3b7/0x80c8383f484910d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413408:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.413410:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.413411:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.413445:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.413450:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413457:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.413461:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.413465:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413474:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413482:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413490:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413676:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.413687:0:16042:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.413692:0:16042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413700:0:16042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.413704:0:16042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413713:0:16042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413794:0:16042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413801:0:16042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f484910de lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.413819:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.413822:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.413825:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.414308:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.414322:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414330:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.414334:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.414339:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788753063.414424:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.414430:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414438:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.414445:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.414449:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414458:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414465:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414472:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414487:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.414528:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414537:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414545:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414557:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.414561:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414568:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.414572:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414580:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414605:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414612:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d786efec/0x80c8383f484910ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.414626:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.414628:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.414630:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.414645:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.414707:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.414713:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414789:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ca00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753063.414793:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414801:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414814:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414833:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b6be9b6/0x80c8383f484910e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.414854:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.414856:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.414858:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.415342:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:1.0:1788753063.415499:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.415506:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415519:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415531:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.415534:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.415539:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415549:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415557:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415564:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415588:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.415599:0:16042:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.415603:0:16042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415610:0:16042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4d000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.415613:0:16042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415622:0:16042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415633:0:16042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415640:0:16042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bdcca7c/0x80c8383f484910f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415654:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.415656:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.415658:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.415780:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.415784:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.415789:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.415799:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.415809:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.415817:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.415836:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.415842:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.415848:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415857:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.415867:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415876:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415888:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415896:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f484910fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.415911:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.415913:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.415915:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.416427:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788753063.416439:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416448:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.416451:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.416456:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416466:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416474:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416482:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416496:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788753063.416505:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753063.416520:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416527:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8600 already unused, calling callback (ffffffffc14dd940) 00002000:00010000:0.0:1788753063.416719:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.416726:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416735:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.416739:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.416743:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416752:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416761:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416774:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416788:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.416797:0:16042:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.416801:0:16042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416807:0:16042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.416810:0:16042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416819:0:16042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416832:0:16042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416839:0:16042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058e6138f/0x80c8383f48491108 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.416854:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.416856:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.416858:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.416883:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416895:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.416995:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.417003:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c016ae55/0x80c8383f48491101 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.417022:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.417025:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.417027:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.417769:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.417784:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417794:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.417797:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.417801:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417812:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417821:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417830:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417847:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.417858:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.417863:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417870:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4de00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.417874:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788753063.417880:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.417883:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.417888:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417914:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417922:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9254f18/0x80c8383f4849110f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.417948:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.417950:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.417952:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.418048:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.418051:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.418056:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.418067:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.418075:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.418082:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.418194:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753063.418224:0:16042:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.418231:0:16042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418239:0:16042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9e00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753063.418243:0:16042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418251:0:16042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418264:0:16042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418271:0:16042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6114e51/0x80c8383f48491116 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418301:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.418304:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753063.418306:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788753063.418857:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.418863:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418873:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.418877:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.418882:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418893:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418902:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418910:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.418944:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788753063.418968:0:14444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788753063.418976:0:14444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.418997:0:14444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4dc00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.419001:0:14444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.419010:0:14444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.419024:0:14444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.419030:0:14444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b590509/0x80c8383f4849111d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.419047:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.419050:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.419052:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788753063.419511:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00002000:00010000:0.0:1788753063.419664:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.419671:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.419691:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.419695:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.419700:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.419709:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.419718:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.419724:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.419749:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788753063.419963:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788753063.419970:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.419977:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.419982:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.419987:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.419991:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.419995:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.419998:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.420003:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.420010:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.420011:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.420018:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080620015/0x80c8383f4849112b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.420020:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.420027:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.420036:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788753063.420039:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.420045:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8800 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.420048:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.420061:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.420072:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.420080:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.420082:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.420095:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788753063.420101:0:16038:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035a71a0c/0x80c8383f48491124 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788753063.420565:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788753063.420573:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.420582:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=463s v=(0 0) 00010000:00010000:0.0:1788753063.420585:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753063.420589:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.420599:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.420618:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753063.420625:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788753063.421523:0:16038:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788753063.421613:0:16042:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788753063.421621:0:16042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.421630:0:16042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753063.421634:0:16042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.421643:0:16042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.421659:0:16042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753063.421687:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.421689:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753063.421691:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753063.422173:0:16038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.422195:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1788753063.422199:0:16038:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753063.422205:0:16038:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.422218:0:16038:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.422228:0:16038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.422236:0:16038:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753063.422254:0:16038:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788753063.422728:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753063.422738:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788753063.422747:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2d0cad/0x80c8383f48491132 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788753063.423034:0:15141:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788753063.423141:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14479:x1875643182706944:12345-0@lo:5:osp-pre-0-0.0 Request processed in 75626us (76092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753063.423154:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788753063.423213:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788753063.423272:0:14479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14479:1875643182706944:0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788753063.423288:0:16038:0:(ofd_dev.c:1520:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000004:00080000:0.0:1788753063.423290:0:14479:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788753063.423341:0:14479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14479:1875643182707328:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788753063.423342:0:16038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14481:x1875643182707200:12345-0@lo:5:osp-pre-1-0.0 Request processed in 64145us (72187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753063.423352:0:16038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788753063.423392:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14481:1875643182707200:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788753063.423395:0:14479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788753063.423405:0:14481:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788753063.423429:0:14481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14481:1875643182707456:0@lo:5:osp-pre-1-0.0 00010000:00010000:3.0:1788753063.423629:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788753063.424166:0:14479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba3ab0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788753063.424579:0:14481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788753063.425003:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.425034:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753063.425039:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.425051:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.425074:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.425083:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c860fbe/0x80c8383f48491139 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 16038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753063.425110:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.425112:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788753063.425115:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788753063.425672:0:16038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707328 00000100:00100000:1.0:1788753063.425683:0:16038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707328 00000100:00100000:3.0:1788753063.425788:0:14481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a87b386c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788753063.425877:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707456 00000100:00100000:0.0:1788753063.425882:0:15144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707456 00000100:00100000:1.0:1788753063.425951:0:16038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788753063.425960:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788753063.425965:0:16038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14479:x1875643182707328:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788753063.425974:0:15144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14481:x1875643182707456:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788753063.426020:0:16038:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00002000:00080000:0.0:1788753063.426020:0:15144:0:(ofd_dev.c:1749:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1788753063.435363:0:15144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14481:x1875643182707456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9387us (10777us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788753063.435376:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788753063.435498:0:14481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e01500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14481:1875643182707456:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788753063.435512:0:14481:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788753063.435857:0:16038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14479:x1875643182707328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9896us (12464us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788753063.435865:0:16038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788753063.435996:0:14479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14479:1875643182707328:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788753063.436003:0:14479:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1788753063.532448:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753064.554283:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788753064.705996:0:6714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788753064.706010:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788753065.579539:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788753065.716147:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788753065.716492:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:2.0:1788753066.245840:0:16219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788753066.602366:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788753067.629880:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788753068.053784:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.053872:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164891776 00000100:00100000:1.0:1788753068.053882:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164891776 00000100:00100000:1.0:1788753068.053931:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:1.0:1788753068.053939:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2357:x1875643164891776:12345-192.168.203.5@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788753068.053966:0:14449:0:(ldlm_lib.c:1456:target_handle_connect()) MGS: connection from b4d3dae1-d843-4045-abf5-6b7f9bfffc0e@192.168.203.5@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1788753068.053992:0:14449:0:(genops.c:1384:class_connect()) connect: client b4d3dae1-d843-4045-abf5-6b7f9bfffc0e, cookie 0x80c8383f48491140 00000100:00080000:1.0:1788753068.054204:0:14449:0:(import.c:65:import_set_state_nolock()) ffff9c9a87953000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788753068.058253:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+5:2357:x1875643164891776:12345-192.168.203.5@tcp:250:mount.lustre.0 Request processed in 4296us (4460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.058269:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 74 00000100:00100000:3.0:1788753068.063230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753068.063325:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164891904 00000100:00100000:0.0:1788753068.063335:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164891904 00000100:00100000:0.0:1788753068.063386:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:0.0:1788753068.063396:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+5:13742:x1875643164891904:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788753068.063411:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753068.063427:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4de00/0x80c8383f48491147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f303 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.063453:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4de00/0x80c8383f48491147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f303 expref: 6 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.063464:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9a85e4de00/0x80c8383f48491147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f303 expref: 6 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.063473:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4de00, rc 0) 00000100:00100000:0.0:1788753068.063630:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+6:13742:x1875643164891904:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.063648:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 75 00000100:00100000:1.0:1788753068.067684:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753068.067862:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892032 00000100:00100000:0.0:1788753068.067874:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892032 00000100:00100000:0.0:1788753068.067937:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:0.0:1788753068.067947:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+6:13742:x1875643164892032:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788753068.068271:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+6:13742:x1875643164892032:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 325us (594us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788753068.068280:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 76 00000100:00100000:3.0:1788753068.079225:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753068.079960:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892160 00000100:00100000:0.0:1788753068.079974:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892160 00000100:00100000:0.0:1788753068.080059:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:0.0:1788753068.080072:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+6:13742:x1875643164892160:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788753068.080097:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753068.080162:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4c400/0x80c8383f4849114e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f30a expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.080198:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4c400/0x80c8383f4849114e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f30a expref: 7 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.080211:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9a85e4c400/0x80c8383f4849114e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f30a expref: 7 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.080220:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c400, rc 0) 00000100:00100000:1.0:1788753068.080741:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+7:13742:x1875643164892160:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 668us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.080750:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 77 00000100:00100000:3.0:1788753068.089300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753068.089738:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892288 00000100:00100000:2.0:1788753068.089752:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892288 00000100:00100000:2.0:1788753068.089819:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:2.0:1788753068.089831:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+7:13742:x1875643164892288:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788753068.090796:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13742:x1875643164892288:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 961us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753068.090821:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 78 00000100:00100000:0.0:1788753068.095115:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.095468:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892416 00000100:00100000:1.0:1788753068.095673:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892416 00000100:00100000:1.0:1788753068.095777:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:1.0:1788753068.095791:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13742:x1875643164892416:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788753068.096180:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13742:x1875643164892416:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 390us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.096201:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 79 00000100:00100000:2.0:1788753068.099655:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753068.100066:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892544 00000100:00100000:3.0:1788753068.100080:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892544 00000100:00100000:3.0:1788753068.100178:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:3.0:1788753068.100192:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13760:x1875643164892544:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788753068.100652:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13760:x1875643164892544:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 460us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.100662:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 80 00000100:00100000:2.0:1788753068.108260:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753068.108358:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892672 00000100:00100000:3.0:1788753068.108372:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892672 00000100:00100000:3.0:1788753068.108444:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:3.0:1788753068.108455:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13760:x1875643164892672:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788753068.108806:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13760:x1875643164892672:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 350us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.108815:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 81 00000100:00100000:2.0:1788753068.119774:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753068.120186:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892800 00000100:00100000:0.0:1788753068.120200:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892800 00000100:00100000:0.0:1788753068.121773:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:0.0:1788753068.121817:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+8:13742:x1875643164892800:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788753068.121841:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753068.121867:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4dc00/0x80c8383f48491155 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f334 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.121915:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4dc00/0x80c8383f48491155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f334 expref: 9 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.121929:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9a85e4dc00/0x80c8383f48491155 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f334 expref: 9 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753068.121940:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4dc00, rc 0) 00000100:00100000:0.0:1788753068.122977:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+9:13742:x1875643164892800:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 228us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.122997:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 82 00000100:00100000:2.0:1788753068.127734:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.130641:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164892928 00000100:00100000:1.0:1788753068.130660:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164892928 00000100:00100000:1.0:1788753068.130748:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:1.0:1788753068.130760:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+9:13742:x1875643164892928:12345-192.168.203.5@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788753068.130795:0:14447:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788753068.130826:0:14447:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788753068.130831:0:14447:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788753068.130835:0:14447:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788753068.130837:0:14447:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788753068.134017:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+9:13742:x1875643164892928:12345-192.168.203.5@tcp:256:mount.lustre.0 Request processed in 3246us (6286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.134033:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 83 00000100:00100000:2.0:1788753068.137827:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.137942:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893056 00000100:00100000:1.0:1788753068.137956:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893056 00000100:00100000:1.0:1788753068.138029:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:1.0:1788753068.138041:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe1ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+9:13742:x1875643164893056:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788753068.138066:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753068.138089:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f33b expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753068.138172:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753068.138186:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 10 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753068.138221:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8600, rc 0) 00000100:00100000:1.0:1788753068.138295:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe1ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13742:x1875643164893056:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 255us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.138303:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 84 00000100:00100000:2.0:1788753068.139962:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.140090:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893184 00000100:00100000:1.0:1788753068.140113:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893184 00000100:00100000:1.0:1788753068.140278:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:1.0:1788753068.140289:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13742:x1875643164893184:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788753068.140874:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13742:x1875643164893184:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 583us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.140884:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 85 00000100:00100000:2.0:1788753068.142287:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753068.142333:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893312 00000100:00100000:3.0:1788753068.142354:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893312 00000100:00100000:3.0:1788753068.142414:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:3.0:1788753068.142426:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13742:x1875643164893312:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788753068.142752:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13742:x1875643164893312:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 328us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.142761:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 86 00000100:00100000:2.0:1788753068.145417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.145679:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893440 00000100:00100000:1.0:1788753068.145691:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893440 00000100:00100000:1.0:1788753068.145757:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:1.0:1788753068.145768:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13765:x1875643164893440:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788753068.146486:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13765:x1875643164893440:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 716us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.146495:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 87 00000100:00100000:2.0:1788753068.154841:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753068.155582:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893568 00000100:00100000:3.0:1788753068.155617:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893568 00000100:00100000:3.0:1788753068.155730:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:3.0:1788753068.155742:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13765:x1875643164893568:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788753068.156099:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13765:x1875643164893568:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 357us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.156108:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 88 00000100:00100000:2.0:1788753068.164483:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.164804:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893696 00000100:00100000:1.0:1788753068.164817:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893696 00000100:00100000:1.0:1788753068.164878:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:1.0:1788753068.164889:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2357:x1875643164893696:12345-192.168.203.5@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788753068.164940:0:14456:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from 472192c3-7fea-4fd7-bf59-65fb04537d51@192.168.203.5@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:1.0:1788753068.165011:0:14456:0:(genops.c:1384:class_connect()) connect: client 472192c3-7fea-4fd7-bf59-65fb04537d51, cookie 0x80c8383f48491163 00000004:00100000:1.0:1788753068.165071:0:14456:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788753068.165079:0:14456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788753068.198808:0:14456:0:(import.c:65:import_set_state_nolock()) ffff9c9b8a00b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788753068.198970:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2357:x1875643164893696:12345-192.168.203.5@tcp:38:mount.lustre.0 Request processed in 34077us (34500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.198984:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:0.0:1788753068.203306:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.203425:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893952 00000100:00100000:1.0:1788753068.203437:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893952 00000100:00100000:1.0:1788753068.203596:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:1.0:1788753068.203612:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13742:x1875643164893952:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788753068.203670:0:14457:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788753068.203788:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13742:x1875643164893952:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 181us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.203796:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:3.0:1788753068.206302:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753068.206485:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164893824 00000100:00100000:0.0:1788753068.206497:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164893824 00000100:00100000:0.0:1788753068.206563:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:0.0:1788753068.206574:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+6:0:x1875643164893824:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788753068.206612:0:16034:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788753068.206692:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+6:0:x1875643164893824:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 120us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.206722:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00080000:2.0:1788753068.206935:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788753068.212778:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.212853:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894080 00000100:00100000:1.0:1788753068.212864:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894080 00000100:00100000:1.0:1788753068.212948:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1788753068.212960:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13742:x1875643164894080:12345-192.168.203.5@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788753068.213329:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13742:x1875643164894080:12345-192.168.203.5@tcp:40:mount.lustre.0 Request processed in 308us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.213390:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1788753068.217418:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.217590:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753068.217633:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753068.217752:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894208 00000100:00100000:0.0:1788753068.217767:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894208 00000100:00100000:0.0:1788753068.217825:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894336 00000100:00100000:0.0:1788753068.217829:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894336 00000100:00100000:0.0:1788753068.217852:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:0.0:1788753068.217862:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875643164894208:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788753068.217918:0:15141:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from 472192c3-7fea-4fd7-bf59-65fb04537d51@192.168.203.5@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1788753068.217966:0:15141:0:(genops.c:1384:class_connect()) connect: client 472192c3-7fea-4fd7-bf59-65fb04537d51, cookie 0x80c8383f4849116a 00002000:00100000:0.0:1788753068.217983:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 472192c3-7fea-4fd7-bf59-65fb04537d51/ffff9c9b8a008000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788753068.218015:0:15141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788753068.218487:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788753068.218530:0:15141:0:(import.c:65:import_set_state_nolock()) ffff9c9b8a008800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788753068.218621:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2357:x1875643164894208:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 758us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.218631:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:0.0:1788753068.218654:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:0.0:1788753068.218659:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875643164894336:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788753068.218678:0:15141:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from 472192c3-7fea-4fd7-bf59-65fb04537d51@192.168.203.5@tcp t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1788753068.218702:0:15141:0:(genops.c:1384:class_connect()) connect: client 472192c3-7fea-4fd7-bf59-65fb04537d51, cookie 0x80c8383f48491171 00002000:00100000:0.0:1788753068.218717:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 472192c3-7fea-4fd7-bf59-65fb04537d51/ffff9c9b8a00c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788753068.218734:0:15141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788753068.218988:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788753068.219005:0:15141:0:(import.c:65:import_set_state_nolock()) ffff9c9b8a00f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788753068.219057:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2357:x1875643164894336:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 396us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.219064:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1788753068.219587:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894464 00000100:00100000:3.0:1788753068.219595:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894464 00000100:00100000:3.0:1788753068.219909:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:3.0:1788753068.219920:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13742:x1875643164894464:12345-192.168.203.5@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788753068.223589:0:14458:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3590us 00000004:00200000:2.0:1788753068.236055:0:14458:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788753068.236229:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13742:x1875643164894464:12345-192.168.203.5@tcp:33:mount.lustre.0 Request processed in 16303us (18819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753068.236246:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1788753068.431279:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753068.431428:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894592 00000100:00100000:3.0:1788753068.431444:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894592 00000100:00100000:3.0:1788753068.431535:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788753068.431549:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13786:x1875643164894592:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:3.0:1788753068.431577:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753068.431767:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48491178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f365 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753068.431870:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173c00/0x80c8383f4849117f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753068.431885:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173c00/0x80c8383f4849117f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753068.431911:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173c00/0x80c8383f4849117f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788753068.431967:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788753068.431971:0:14456:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788753068.432022:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173c00/0x80c8383f4849117f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753068.432676:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f48491178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f365 expref: 8 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753068.432704:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173c00/0x80c8383f4849117f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f365 expref: 7 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753068.432713:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:3.0:1788753068.432716:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788753068.432720:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173c00, rc 0) 00000100:00100000:3.0:1788753068.432800:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+7:13786:x1875643164894592:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1246us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.432810:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00010000:00010000:1.0:1788753068.651215:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788753068.714556:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182707712:0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.714650:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753068.714722:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182708224:0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.714752:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753068.714780:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788753068.714787:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182707584:0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.714823:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753068.714901:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182707968:0@lo:400:kworker.0 00000100:00100000:3.0:1788753068.714936:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753068.714967:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788753068.714981:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708224 00000100:00100000:0.0:1788753068.714993:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708224 00000100:00100000:3.0:1788753068.714997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753068.715034:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788753068.715040:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182707840:0@lo:400:kworker.0 00000100:00100000:0.0:1788753068.715071:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707968 00000100:00100000:0.0:1788753068.715075:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707968 00000100:00100000:3.0:1788753068.715079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753068.715103:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788753068.715112:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788753068.715145:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182708224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788753068.715154:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788753068.715216:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788753068.715218:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875643182708224:12345-0@lo:400:kworker.0 Request processed in 95us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.715227:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788753068.715246:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788753068.715257:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182707968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753068.715271:0:16037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708480 00000100:00100000:0.0:1788753068.715276:0:16037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708480 00000100:00100000:3.0:1788753068.715315:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875643182707968:12345-0@lo:400:kworker.0 Request processed in 60us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.715316:0:16037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708352 00000100:00100000:0.0:1788753068.715322:0:16037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708352 00000100:00100000:3.0:1788753068.715328:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788753068.715351:0:16037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788753068.715360:0:16037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708480:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788753068.715364:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788753068.715377:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788753068.715384:0:16037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00002000:00000024:3.0:1788753068.715391:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788753068.715433:0:16037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.715442:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753068.715446:0:16037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788753068.715456:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788753068.715473:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788753068.715478:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788753068.715502:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788753068.715502:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707712 00000100:00100000:0.0:1788753068.715508:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707712 00000100:00100000:3.0:1788753068.715533:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788753068.715541:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707840 00000100:00100000:0.0:1788753068.715546:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707840 00000100:00100000:3.0:1788753068.715549:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788753068.715567:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788753068.715572:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788753068.715582:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875643182707968:0@lo:400:kworker.0 00000100:00100000:0.0:1788753068.715593:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182707712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753068.715635:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875643182707712:12345-0@lo:400:kworker.0 Request processed in 46us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.715641:0:16038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788753068.715650:0:16038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182707840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753068.715680:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788753068.715688:0:16038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182707840:12345-0@lo:400:kworker.0 Request processed in 38us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753068.715696:0:16038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788753068.715728:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182707840:0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.716069:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182708096:0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.716107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753068.716156:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3306:1875643182707712:0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.716168:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3306:1875643182708224:0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.716208:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708096 00000100:00100000:2.0:1788753068.716213:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708096 00000100:00100000:2.0:1788753068.716263:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788753068.716270:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182708096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753068.716307:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875643182708096:12345-0@lo:400:kworker.0 Request processed in 37us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753068.716313:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788753068.716346:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3306:1875643182708096:0@lo:400:kworker.0 00000100:00080000:3.0:1788753068.716993:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788753068.717268:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182707584 00000100:00100000:1.0:1788753068.717277:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182707584 00000100:00100000:1.0:1788753068.717375:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788753068.717386:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3306:x1875643182707584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788753068.717479:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3306:x1875643182707584:12345-0@lo:400:kworker.0 Request processed in 94us (2654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753068.717495:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788753068.717580:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbde9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182707584:0@lo:400:kworker.0 00010000:00010000:3.0:1788753069.675360:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788753069.778644:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 472192c3-7fea-4fd7-bf59-65fb04537d51 00000100:00100000:2.0:1788753070.216926:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753070.217793:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894720 00000100:00100000:0.0:1788753070.217808:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894720 00000100:00100000:0.0:1788753070.217977:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:0.0:1788753070.217991:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+7:13839:x1875643164894720:12345-192.168.203.5@tcp:41:lfs.0 00000004:00000024:0.0:1788753070.218056:0:14456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788753070.218225:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+7:13839:x1875643164894720:12345-192.168.203.5@tcp:41:lfs.0 Request processed in 237us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753070.218233:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00080000:3.0:1788753070.218820:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788753070.224839:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.226173:0:16037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894848 00000100:00100000:2.0:1788753070.226192:0:16037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894848 00000100:00100000:2.0:1788753070.226299:0:16037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:2.0:1788753070.226313:0:16037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:472192c3-7fea-4fd7-bf59-65fb04537d51+5:13839:x1875643164894848:12345-192.168.203.5@tcp:13:lfs.0 00002000:00000024:2.0:1788753070.226366:0:16037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788753070.226423:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788753070.226477:0:16037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:472192c3-7fea-4fd7-bf59-65fb04537d51+5:13839:x1875643164894848:12345-192.168.203.5@tcp:13:lfs.0 Request processed in 167us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.226485:0:16037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:1.0:1788753070.230784:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.230924:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164894976 00000100:00100000:2.0:1788753070.230939:0:15145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164894976 00000100:00100000:2.0:1788753070.231035:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1788753070.231048:0:15145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13839:x1875643164894976:12345-192.168.203.5@tcp:13:lfs.0 00002000:00000024:2.0:1788753070.231097:0:15145:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788753070.231259:0:15145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:472192c3-7fea-4fd7-bf59-65fb04537d51+6:13839:x1875643164894976:12345-192.168.203.5@tcp:13:lfs.0 Request processed in 213us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.231266:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00080000:3.0:1788753070.231798:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788753070.399742:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753070.399854:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164895104 00000100:00100000:0.0:1788753070.399868:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164895104 00000100:00100000:0.0:1788753070.399945:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:0.0:1788753070.399958:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+10:13874:x1875643164895104:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788753070.399980:0:14450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753070.400003:0:14450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9a85e4c600/0x80c8383f48491186 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f36c expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753070.400041:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9a85e4c600/0x80c8383f48491186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f36c expref: 11 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753070.400053:0:14450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9a85e4c600/0x80c8383f48491186 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f36c expref: 11 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753070.400088:0:14450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c600, rc 0) 00000100:00100000:0.0:1788753070.400290:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13874:x1875643164895104:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 332us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753070.400298:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 90 00000100:00100000:1.0:1788753070.408381:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.408505:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164895232 00000100:00100000:2.0:1788753070.408518:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164895232 00000100:00100000:2.0:1788753070.408601:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:2.0:1788753070.408614:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13874:x1875643164895232:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788753070.409269:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13874:x1875643164895232:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 655us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.409279:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 91 00000100:00100000:1.0:1788753070.419887:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753070.420047:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164895360 00000100:00100000:0.0:1788753070.420059:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164895360 00000100:00100000:0.0:1788753070.420112:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:0.0:1788753070.420146:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13874:x1875643164895360:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788753070.420427:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13874:x1875643164895360:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 305us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753070.420437:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 92 00000100:00100000:3.0:1788753070.424300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.425071:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164895488 00000100:00100000:2.0:1788753070.425087:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164895488 00000100:00100000:2.0:1788753070.425193:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:2.0:1788753070.425205:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13878:x1875643164895488:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788753070.427908:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13878:x1875643164895488:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 2690us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.427926:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 93 00000100:00100000:2.0:1788753070.439234:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753070.439323:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164895616 00000100:00100000:1.0:1788753070.439334:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164895616 00000100:00100000:1.0:1788753070.439399:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:1.0:1788753070.439410:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13878:x1875643164895616:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788753070.440075:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13878:x1875643164895616:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 665us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753070.440084:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 94 00000100:00100000:1.0:1788753070.444287:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.444382:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164895744 00000100:00100000:2.0:1788753070.444395:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164895744 00000100:00100000:2.0:1788753070.444472:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:2.0:1788753070.444486:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13874:x1875643164895744:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788753070.444519:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753070.444558:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b0e00/0x80c8383f4849118d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f396 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.444616:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b0e00/0x80c8383f4849118d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f396 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.444629:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b0e00/0x80c8383f4849118d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f396 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.444644:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0e00, rc 0) 00000100:00100000:2.0:1788753070.444730:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13874:x1875643164895744:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 246us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.444738:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 95 00000100:00100000:3.0:1788753070.449114:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753070.449323:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164895872 00000100:00100000:1.0:1788753070.449337:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164895872 00000100:00100000:1.0:1788753070.449408:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:1.0:1788753070.449421:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13874:x1875643164895872:12345-192.168.203.5@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788753070.449458:0:14449:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788753070.451136:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788753070.451148:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788753070.451152:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788753070.451155:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788753070.455852:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13874:x1875643164895872:12345-192.168.203.5@tcp:256:mount.lustre.0 Request processed in 6418us (6736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.455871:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 96 00000100:00100000:2.0:1788753070.464229:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753070.464428:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896000 00000100:00100000:3.0:1788753070.464437:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896000 00000100:00100000:3.0:1788753070.464487:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:3.0:1788753070.464496:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13874:x1875643164896000:12345-192.168.203.5@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788753070.464519:0:14450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753070.464537:0:14450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f39d expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753070.464565:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 13 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753070.464576:0:14450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 13 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753070.464584:0:14450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173000, rc 0) 00000100:00100000:3.0:1788753070.464628:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13874:x1875643164896000:12345-192.168.203.5@tcp:101:mount.lustre.0 Request processed in 134us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753070.464635:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 97 00000100:00100000:3.0:1788753070.469500:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.470106:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896128 00000100:00100000:2.0:1788753070.470116:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896128 00000100:00100000:2.0:1788753070.470288:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:2.0:1788753070.470298:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13874:x1875643164896128:12345-192.168.203.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788753070.470574:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13874:x1875643164896128:12345-192.168.203.5@tcp:501:mount.lustre.0 Request processed in 276us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.470581:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 98 00000100:00100000:1.0:1788753070.475281:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.475485:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896256 00000100:00100000:2.0:1788753070.475494:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896256 00000100:00100000:2.0:1788753070.475548:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:2.0:1788753070.475558:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13874:x1875643164896256:12345-192.168.203.5@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788753070.475918:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13874:x1875643164896256:12345-192.168.203.5@tcp:503:mount.lustre.0 Request processed in 360us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.475927:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 99 00000100:00100000:1.0:1788753070.483476:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753070.483563:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896384 00000100:00100000:3.0:1788753070.483585:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896384 00000100:00100000:3.0:1788753070.483641:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:3.0:1788753070.483652:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb5578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13882:x1875643164896384:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788753070.483935:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb5578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13882:x1875643164896384:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 283us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753070.483944:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 100 00000100:00100000:3.0:1788753070.497436:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.497541:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896512 00000100:00100000:2.0:1788753070.497552:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896512 00000100:00100000:2.0:1788753070.497607:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:2.0:1788753070.497618:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13882:x1875643164896512:12345-192.168.203.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788753070.497889:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13882:x1875643164896512:12345-192.168.203.5@tcp:502:llog_process_th.0 Request processed in 261us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.497898:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 101 00000100:00100000:2.0:1788753070.503589:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.503627:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.503652:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753070.503867:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897152 00000100:00100000:0.0:1788753070.503876:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897152 00000100:00100000:0.0:1788753070.503937:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:0.0:1788753070.503945:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2358:x1875643164897152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788753070.504019:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2358:x1875643164897152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 74us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753070.504027:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:2.0:1788753070.504309:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753070.508227:0:16038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897280 00000100:00100000:0.0:1788753070.508242:0:16038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897280 00000100:00100000:0.0:1788753070.508321:0:16038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:0.0:1788753070.508332:0:16038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2358:x1875643164897280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788753070.508423:0:16038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2358:x1875643164897280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 92us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753070.508446:0:16038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:1.0:1788753070.510463:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896640 00000100:00100000:1.0:1788753070.510477:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896640 00000100:00100000:0.0:1788753070.510616:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897024 00000100:00100000:0.0:1788753070.510620:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897024 00000100:00100000:0.0:1788753070.510673:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:0.0:1788753070.510683:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+7:2358:x1875643164897024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788753070.510888:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:2.0:1788753070.510895:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875643164896640:12345-192.168.203.5@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788753070.510922:0:14457:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-MDT0000: connection from b96b9192-cdd9-4abe-9647-995a2cd48790@192.168.203.5@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1788753070.510961:0:14457:0:(genops.c:1384:class_connect()) connect: client b96b9192-cdd9-4abe-9647-995a2cd48790, cookie 0x80c8383f4849119b 00000004:00100000:2.0:1788753070.510991:0:14457:0:(mdt_handler.c:7491:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788753070.511114:0:14457:0:(import.c:65:import_set_state_nolock()) ffff9c9bb5b9e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788753070.511206:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2357:x1875643164896640:12345-192.168.203.5@tcp:38:mount.lustre.0 Request processed in 308us (7626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.511213:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:0.0:1788753070.511652:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+7:2358:x1875643164897024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 968us (7997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753070.511660:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:0.0:1788753070.519677:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753070.519737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753070.519859:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896768 00000100:00100000:1.0:1788753070.519870:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896768 00000100:00100000:1.0:1788753070.519967:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164896896 00000100:00100000:1.0:1788753070.519971:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164896896 00000100:00100000:1.0:1788753070.520001:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1788753070.520013:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+7:0:x1875643164896768:12345-192.168.203.5@tcp:41:mount.lustre.0 00000100:00080000:3.0:1788753070.520025:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788753070.520061:0:16034:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788753070.520064:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1788753070.520087:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+7:13874:x1875643164896896:12345-192.168.203.5@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788753070.520164:0:14455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788753070.520185:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+7:0:x1875643164896768:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 171us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753070.520194:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:3.0:1788753070.520235:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+6:13874:x1875643164896896:12345-192.168.203.5@tcp:41:mount.lustre.0 Request processed in 157us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753070.520245:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1788753070.530383:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753070.531443:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897408 00000100:00100000:1.0:1788753070.531458:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897408 00000100:00100000:1.0:1788753070.531596:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1788753070.531608:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+6:13874:x1875643164897408:12345-192.168.203.5@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788753070.531810:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+6:13874:x1875643164897408:12345-192.168.203.5@tcp:40:mount.lustre.0 Request processed in 203us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753070.531819:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1788753070.538299:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.538363:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.538446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753070.540869:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897536 00000100:00100000:3.0:1788753070.540895:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897536 00000100:00100000:3.0:1788753070.540954:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897664 00000100:00100000:3.0:1788753070.540957:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897664 00000100:00100000:3.0:1788753070.540977:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788753070.540984:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875643164897536:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788753070.541015:0:15141:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0000: connection from b96b9192-cdd9-4abe-9647-995a2cd48790@192.168.203.5@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1788753070.541044:0:15141:0:(genops.c:1384:class_connect()) connect: client b96b9192-cdd9-4abe-9647-995a2cd48790, cookie 0x80c8383f484911a2 00002000:00100000:3.0:1788753070.541055:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b96b9192-cdd9-4abe-9647-995a2cd48790/ffff9c9bbd900000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788753070.541065:0:15141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788753070.541337:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788753070.541383:0:15141:0:(import.c:65:import_set_state_nolock()) ffff9c9bbd904000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788753070.541445:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2357:x1875643164897536:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 460us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753070.541452:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788753070.541468:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1788753070.541473:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875643164897664:12345-192.168.203.5@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788753070.541487:0:15141:0:(ldlm_lib.c:1456:target_handle_connect()) lustre-OST0001: connection from b96b9192-cdd9-4abe-9647-995a2cd48790@192.168.203.5@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1788753070.541502:0:15141:0:(genops.c:1384:class_connect()) connect: client b96b9192-cdd9-4abe-9647-995a2cd48790, cookie 0x80c8383f484911a9 00002000:00100000:3.0:1788753070.541507:0:15141:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b96b9192-cdd9-4abe-9647-995a2cd48790/ffff9c9b94191800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a2b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788753070.541512:0:15141:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788753070.541561:0:15141:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788753070.541574:0:15141:0:(import.c:65:import_set_state_nolock()) ffff9c9b90a5e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788753070.541597:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2357:x1875643164897664:12345-192.168.203.5@tcp:8:mount.lustre.0 Request processed in 122us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753070.541603:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:0.0:1788753070.542158:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897792 00000100:00100000:0.0:1788753070.542165:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897792 00000100:00100000:0.0:1788753070.542197:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:0.0:1788753070.542204:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b96b9192-cdd9-4abe-9647-995a2cd48790+6:13874:x1875643164897792:12345-192.168.203.5@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788753070.542264:0:14459:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788753070.542309:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b96b9192-cdd9-4abe-9647-995a2cd48790+6:13874:x1875643164897792:12345-192.168.203.5@tcp:33:mount.lustre.0 Request processed in 105us (4020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753070.542316:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00010000:00010000:3.0:1788753070.698472:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788753070.699331:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753070.701606:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164897920 00000100:00100000:2.0:1788753070.701626:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164897920 00000100:00100000:2.0:1788753070.701799:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1788753070.701812:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+6:13903:x1875643164897920:12345-192.168.203.5@tcp:101:mkdir.0 00010000:00010000:2.0:1788753070.701849:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753070.701900:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484911b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3c7 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.702000:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.702016:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.702032:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788753070.702193:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788753070.702198:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788753070.702226:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.702322:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1200/0x80c8383f484911b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 8 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.702344:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753070.702376:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:2.0:1788753070.702379:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788753070.702383:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0000, rc 0) 00000100:00100000:2.0:1788753070.703436:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+7:13903:x1875643164897920:12345-192.168.203.5@tcp:101:mkdir.0 Request processed in 1621us (4108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753070.703446:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000001:00100000:1.0:1788753070.810327:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 472192c3-7fea-4fd7-bf59-65fb04537d51 00000001:00100000:1.0:1788753070.810350:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b96b9192-cdd9-4abe-9647-995a2cd48790 00000040:00080000:0.0:1788753070.954832:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788753071.729916:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753072.746608:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788753073.017920:0:16421:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1788753073.355721:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 472192c3-7fea-4fd7-bf59-65fb04537d51 00000001:00100000:0.0:1788753073.355948:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b96b9192-cdd9-4abe-9647-995a2cd48790 00010000:00010000:3.0:1788753073.773704:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788753073.834404:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cf43312c-18dc-4b92-a763-9e6fba828a91:3305:1875643182708608:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.834477:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753073.834773:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182709120:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.834804:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753073.834871:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788753073.834878:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182708736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788753073.834902:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753073.834923:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182709248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788753073.834943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753073.835207:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708736 00000100:00100000:2.0:1788753073.835216:0:15146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708736 00000100:00100000:2.0:1788753073.835268:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182709248 00000100:00100000:2.0:1788753073.835271:0:15146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182709248 00000100:00100000:2.0:1788753073.835289:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788753073.835297:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182708736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788753073.835330:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788753073.835436:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182708736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753073.835443:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788753073.835477:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788753073.835484:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182709248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788753073.835503:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788753073.835531:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182709248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753073.835536:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788753073.835556:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788753073.835560:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788753073.835592:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182708736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788753073.835604:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182709248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788753073.835644:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708992:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.835668:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753073.835687:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788753073.835692:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708864:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.835710:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753073.835734:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708992 00000100:00100000:2.0:1788753073.835739:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708992 00000100:00100000:2.0:1788753073.835760:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708864 00000100:00100000:2.0:1788753073.835764:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708864 00000100:00100000:2.0:1788753073.835780:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788753073.835786:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753073.835956:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182709120 00000100:00100000:0.0:1788753073.835970:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182709120 00000100:00100000:0.0:1788753073.836002:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788753073.836009:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182709120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753073.836201:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875643182709120:12345-0@lo:400:kworker.0 Request processed in 192us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753073.836208:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788753073.836294:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182708608 00000100:00100000:1.0:1788753073.836299:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182708608 00000100:00100000:1.0:1788753073.836339:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788753073.836346:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3305:x1875643182708608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788753073.836487:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3305:x1875643182708608:12345-0@lo:400:kworker.0 Request processed in 142us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753073.836504:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788753073.836544:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788753073.836552:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788753073.836582:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708864:12345-0@lo:400:kworker.0 Request processed in 32us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753073.836588:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788753073.836780:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182709376:0@lo:400:kworker.0 00000100:00100000:0.0:1788753073.836813:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753073.836921:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182709376 00000100:00100000:1.0:1788753073.836926:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182709376 00000100:00100000:1.0:1788753073.836957:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788753073.836975:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182709376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.837048:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875643182708992:12345-0@lo:400:kworker.0 Request processed in 34us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753073.837058:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788753073.837087:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182709504:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.837114:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753073.837171:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708864:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.837182:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3304:1875643182708992:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.837208:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182709504 00000100:00100000:2.0:1788753073.837212:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182709504 00000100:00100000:2.0:1788753073.837237:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788753073.837244:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182709504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.837277:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875643182709504:12345-0@lo:400:kworker.0 Request processed in 34us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753073.837283:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788753073.837308:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3304:1875643182709504:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.837330:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875643182709120:0@lo:400:kworker.0 00000100:00100000:2.0:1788753073.837340:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bb57b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cf43312c-18dc-4b92-a763-9e6fba828a91:3305:1875643182708608:0@lo:400:kworker.0 00000100:00080000:0.0:1788753073.845246:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788753073.850488:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182709376:12345-0@lo:400:kworker.0 Request processed in 13514us (13664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753073.850502:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788753073.851220:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182709376:0@lo:400:kworker.0 00010000:00010000:0.0:1788753074.794303:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788753074.912963:0:6714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b96b9192-cdd9-4abe-9647-995a2cd48790 00000020:00000080:1.0:1788753075.730782:0:16574:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2ac4e800 20000000:00000080:1.0:1788753075.730798:0:16574:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c9b995ba400 uarg=0000000000000000 20000000:01000000:1.0:1788753075.730834:0:16574:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788753075.730839:0:16574:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788753075.730854:0:16574:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788753075.732283:0:16575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788753075.732368:0:16574:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788753075.745005:0:16574:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788753075.745037:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745059:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490eae expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745067:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490efb expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745089:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f48490f6b expref: 18 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745099:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745106:0:16574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 12 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745114:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745621:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 12 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745637:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 12 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.745652:0:16574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182709632:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788753075.745748:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745757:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 12 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.745765:0:16574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182709760:192.168.203.5@tcp:104: 00010000:00010000:3.0:1788753075.745798:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f48490f6b expref: 18 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745818:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f48490f6b expref: 18 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.745828:0:16574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182709888:0@lo:104: 00000100:00100000:3.0:1788753075.745886:0:16574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788753075.745932:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f48490efb expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.745941:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f48490efb expref: 18 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.745951:0:16574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182710016:0@lo:104: 00000100:00100000:3.0:1788753075.745979:0:16574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753075.746035:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182709888 00000100:00100000:1.0:1788753075.746043:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182709888 00000100:00100000:1.0:1788753075.746172:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710016 00000100:00100000:1.0:1788753075.746176:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710016 00000100:00100000:1.0:1788753075.746197:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788753075.746207:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+4:16574:x1875643182709888:12345-0@lo:104: 00010000:00010000:1.0:1788753075.746219:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746279:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788753075.746286:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+4:16574:x1875643182709888:12345-0@lo:104: Request processed in 81us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753075.746294:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788753075.746312:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788753075.746319:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:16574:x1875643182710016:12345-0@lo:104: 00010000:00010000:1.0:1788753075.746332:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746374:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788753075.746379:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:16574:x1875643182710016:12345-0@lo:104: Request processed in 62us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753075.746398:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788753075.746418:0:16042:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788753075.746435:0:16042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746443:0:16042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4d200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788753075.746447:0:16042:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746456:0:16042:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788753075.746463:0:16042:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788753075.746469:0:16042:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788753075.746506:0:16042:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746513:0:16042:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788753075.746533:0:16042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746541:0:16042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4d200/0x80c8383f48490f6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f72 expref: -99 pid: 15857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746554:0:16042:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788753075.746557:0:16042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746563:0:16042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bbe271200 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:1.0:1788753075.746566:0:16042:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746574:0:16042:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788753075.746580:0:16042:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788753075.746586:0:16042:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788753075.746601:0:16042:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746608:0:16042:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788753075.746614:0:16042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746632:0:16042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9bbe271200/0x80c8383f48490efb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490f02 expref: -99 pid: 15140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746644:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753075.746646:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753075.746648:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788753075.746655:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788753075.746674:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182710272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788753075.746706:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753075.746744:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788753075.746752:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182710144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788753075.746778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753075.746816:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710272 00000100:00100000:1.0:1788753075.746820:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710272 00010000:00010000:1.0:1788753075.746839:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490efb expref: 19 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.746871:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710144 00000100:00100000:1.0:1788753075.746874:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710144 00010000:00010000:1.0:1788753075.746886:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490f6b expref: 20 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.746897:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788753075.746903:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+20:3306:x1875643182710272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788753075.746912:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788753075.746916:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490efb expref: 20 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746935:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f48490efb expref: 20 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.746950:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788753075.746967:0:14440:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788753075.746977:0:14440:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788753075.746985:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+20:3306:x1875643182710272:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753075.746992:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788753075.746994:0:14441:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788753075.747006:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788753075.747015:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3306:x1875643182710144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788753075.747026:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788753075.747032:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490f6b expref: 19 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.747036:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182710272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788753075.747049:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f48490f6b expref: 19 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.747061:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788753075.747096:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3306:x1875643182710144:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753075.747109:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788753075.747285:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182710144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788753075.749999:0:16574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x80c8383f48490eae expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.750018:0:16574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x80c8383f48490eae expref: 18 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.750032:0:16574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182710400:0@lo:104: 00000100:00100000:3.0:1788753075.750092:0:16574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753075.750162:0:16574:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91432300 going to sleep for 11 seconds 00010000:00010000:3.0:1788753075.750187:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173200/0x80c8383f48490f72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f48490f6b expref: 18 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.750201:0:16574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182709888:0@lo:104: 00010000:00010000:3.0:1788753075.750212:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2172000/0x80c8383f48490f02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f48490efb expref: 17 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.750239:0:16574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182710016:0@lo:104: 00000100:00100000:0.0:1788753075.750547:0:14438:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788753075.750565:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710400 00000100:00100000:0.0:1788753075.750571:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710400 00000100:00100000:0.0:1788753075.750626:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788753075.750636:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:16574:x1875643182710400:12345-0@lo:104: 00010000:00010000:0.0:1788753075.750649:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753075.750715:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788753075.750721:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde2f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cf43312c-18dc-4b92-a763-9e6fba828a91+3:16574:x1875643182710400:12345-0@lo:104: Request processed in 87us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753075.750728:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788753075.750771:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753075.750777:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753075.750784:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4da00 already unused, calling callback (ffffffffc1b05c20) 10000000:00010000:0.0:1788753075.750789:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753075.750809:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788753075.750816:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788753075.750822:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788753075.750933:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753075.750940:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788753075.750960:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753075.750967:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4da00/0x80c8383f48490eae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x80c8383f48490eb5 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753075.750983:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753075.750985:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753075.750986:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788753075.750998:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182710528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788753075.751029:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753075.751357:0:16574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182710400:0@lo:104: 00000100:00100000:1.0:1788753075.751759:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753075.751851:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753075.751901:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710528 00000100:00100000:1.0:1788753075.751907:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710528 00010000:00010000:1.0:1788753075.751935:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490eae expref: 17 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.751957:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898048 00000100:00100000:1.0:1788753075.751960:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898048 00010000:00010000:1.0:1788753075.751975:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 13 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.751986:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898176 00000100:00100000:1.0:1788753075.751988:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898176 00010000:00010000:1.0:1788753075.752000:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 14 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.752012:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788753075.752020:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88add450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:3303:x1875643182710528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788753075.752033:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788753075.752048:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x80c8383f48490eae expref: 17 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.752057:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x80c8383f48490eae expref: 17 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.752071:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9a85e4c000/0x80c8383f48490eb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x80c8383f48490eae expref: 17 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.752084:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788753075.752171:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88add450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cf43312c-18dc-4b92-a763-9e6fba828a91+16:3303:x1875643182710528:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753075.752179:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788753075.752210:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:2.0:1788753075.752224:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+14:2360:x1875643164898048:12345-192.168.203.5@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788753075.752228:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00010000:00010000:2.0:1788753075.752239:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788753075.752243:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+14:2360:x1875643164898176:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788753075.752250:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 14 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.752255:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788753075.752264:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 14 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752268:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 14 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753075.752699:0:16574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182709632:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788753075.752717:0:16574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16574:1875643182709760:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788753075.752765:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 14 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.752779:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9b88bc8600/0x80c8383f4849115c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f33b expref: 14 pid: 14449 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753075.752789:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788753075.752835:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173000/0x80c8383f48491194 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f39d expref: 13 pid: 14450 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.752854:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:2360:x1875643164898176:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 602us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753075.752866:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00010000:00010000:2.0:1788753075.752870:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752883:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752911:0:14441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753075.752915:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cf43312c-18dc-4b92-a763-9e6fba828a91:3303:1875643182710528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788753075.752927:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752935:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752955:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752962:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173a00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753075.752966:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752975:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752985:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753075.752993:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788753075.753020:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:2360:x1875643164898048:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 799us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753075.753027:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00010000:00010000:3.0:1788753075.753099:0:16574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.753109:0:16574:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.753116:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.753337:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753075.818611:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788753076.019958:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753076.020005:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753076.020039:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753076.020070:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753076.020104:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753076.020197:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753076.020198:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898304 00000100:00100000:3.0:1788753076.020210:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898304 00000100:00100000:2.0:1788753076.020231:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898432 00000100:00100000:2.0:1788753076.020238:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898432 00000100:00100000:3.0:1788753076.020276:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898688 00000100:00100000:2.0:1788753076.020276:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898560 00000100:00100000:3.0:1788753076.020281:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898688 00000100:00100000:2.0:1788753076.020283:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898560 00000100:00100000:2.0:1788753076.020304:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898944 00000100:00100000:2.0:1788753076.020307:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898944 00000100:00100000:3.0:1788753076.020320:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:3.0:1788753076.020331:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2358:x1875643164898304:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788753076.020341:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164898816 00000100:00100000:2.0:1788753076.020345:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164898816 00000100:00100000:2.0:1788753076.020359:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788753076.020367:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2359:x1875643164898432:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788753076.020407:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2358:x1875643164898304:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753076.020407:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2359:x1875643164898432:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 38us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753076.020425:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1788753076.020426:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788753076.020451:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1788753076.020457:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:2.0:1788753076.020463:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2358:x1875643164898560:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788753076.020470:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2359:x1875643164898688:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788753076.020493:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2358:x1875643164898560:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 33us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753076.020499:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1788753076.020513:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2359:x1875643164898688:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 46us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753076.020515:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:3.0:1788753076.020526:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:2.0:1788753076.020528:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2359:x1875643164898944:12345-192.168.203.5@tcp:400:kworker.0 00000100:00080000:3.0:1788753076.020548:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788753076.020553:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788753076.020556:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788753076.020562:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2359:x1875643164898944:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753076.020569:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1788753076.020584:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:2.0:1788753076.020591:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2358:x1875643164898816:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788753076.020615:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1568000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2358:x1875643164898816:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 25us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753076.020621:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00010000:00010000:3.0:1788753076.842939:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788753077.620102:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753077.620233:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164899072 00000100:00100000:3.0:1788753077.620243:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164899072 00000100:00100000:3.0:1788753077.620292:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:3.0:1788753077.620302:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+11:13756:x1875643164899072:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788753077.620318:0:14450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753077.620349:0:14450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3ce expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.620379:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3ce expref: 12 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.620390:0:14450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2173a00/0x80c8383f484911c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3ce expref: 12 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.620399:0:14450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173a00, rc 0) 00000100:00100000:3.0:1788753077.620461:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13756:x1875643164899072:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 159us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753077.620468:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 103 00000100:00100000:1.0:1788753077.627485:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753077.627578:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164899200 00000100:00100000:0.0:1788753077.627589:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164899200 00000100:00100000:0.0:1788753077.627646:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:0.0:1788753077.627656:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13756:x1875643164899200:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.628101:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13756:x1875643164899200:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 446us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753077.628116:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 104 00000100:00100000:2.0:1788753077.634808:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753077.634902:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164899328 00000100:00100000:1.0:1788753077.634919:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164899328 00000100:00100000:1.0:1788753077.634968:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 105 00000100:00100000:1.0:1788753077.634978:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13756:x1875643164899328:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788753077.635211:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13756:x1875643164899328:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 233us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753077.635218:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 105 00000100:00100000:2.0:1788753077.654583:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753077.654785:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164899456 00000100:00100000:3.0:1788753077.654802:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164899456 00000100:00100000:3.0:1788753077.654877:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:3.0:1788753077.654888:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+12:13756:x1875643164899456:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788753077.654907:0:14450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753077.654926:0:14450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2172000/0x80c8383f484911cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3d5 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.654956:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2172000/0x80c8383f484911cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3d5 expref: 13 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.654967:0:14450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2172000/0x80c8383f484911cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3d5 expref: 13 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.654976:0:14450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2172000, rc 0) 00000100:00100000:3.0:1788753077.655036:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13756:x1875643164899456:12345-192.168.203.5@tcp:101:ll_cfg_requeue.0 Request processed in 149us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753077.655044:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 106 00000100:00100000:2.0:1788753077.662581:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753077.668108:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164899584 00000100:00100000:0.0:1788753077.668137:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164899584 00000100:00100000:0.0:1788753077.668215:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:0.0:1788753077.668226:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13756:x1875643164899584:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.668542:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13756:x1875643164899584:12345-192.168.203.5@tcp:501:ll_cfg_requeue.0 Request processed in 316us (5967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753077.668549:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 107 00000100:00100000:2.0:1788753077.670523:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753077.670607:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164899712 00000100:00100000:1.0:1788753077.670616:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164899712 00000100:00100000:1.0:1788753077.670671:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 108 00000100:00100000:1.0:1788753077.670681:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13756:x1875643164899712:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788753077.670913:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:13756:x1875643164899712:12345-192.168.203.5@tcp:503:ll_cfg_requeue.0 Request processed in 225us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753077.670922:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 108 10000000:01000000:1.0:1788753077.738294:0:14453:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788753077.738301:0:14453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbd903000 from 10 10000000:01000000:1.0:1788753077.738306:0:14453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788753077.738364:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f484911d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753077.738386:0:14453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f484911d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753077.738398:0:14453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f484911d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753077.738442:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182710656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788753077.738523:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753077.738595:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788753077.739050:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710656 00000100:00100000:3.0:1788753077.739059:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710656 00000100:00100000:3.0:1788753077.739577:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788753077.739590:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+16:14453:x1875643182710656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788753077.739615:0:14450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753077.739630:0:14450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bc2173200/0x80c8383f484911da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f484911d3 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.739655:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bc2173200/0x80c8383f484911da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f484911d3 expref: 17 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.739666:0:14450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bc2173200/0x80c8383f484911da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f484911d3 expref: 17 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753077.739685:0:14450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bc2173200, rc 0) 00000100:00100000:3.0:1788753077.739754:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:14453:x1875643182710656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753077.739763:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788753077.739806:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182710656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788753077.739823:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f484911d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911da expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753077.739844:0:14453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f484911d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f484911da expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753077.739916:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182710784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788753077.739945:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753077.739972:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788753077.740150:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710784 00000100:00100000:0.0:1788753077.740156:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710784 00000100:00100000:0.0:1788753077.740178:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788753077.740185:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+17:14453:x1875643182710784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.740441:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+17:14453:x1875643182710784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753077.740449:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788753077.740593:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e02d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182710784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.740625:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182710912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.740663:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753077.740696:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b86f71900 going to sleep for 11 seconds 00000100:00100000:3.0:1788753077.740937:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182710912 00000100:00100000:3.0:1788753077.740943:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182710912 00000100:00100000:3.0:1788753077.740975:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788753077.740982:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:14453:x1875643182710912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788753077.741151:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:14453:x1875643182710912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753077.741157:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788753077.741287:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182710912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788753077.742451:0:16684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788753077.742916:0:14453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788753077.742937:0:14453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788753077.742947:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f484911d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911da expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753077.742958:0:14453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9b88bc9e00/0x80c8383f484911d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911da expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788753077.742969:0:14453:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788753077.742972:0:14453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9a849f0000 from 10 10000000:01000000:0.0:1788753077.742975:0:14453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788753077.743007:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ca00/0x80c8383f484911e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753077.743025:0:14453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ca00/0x80c8383f484911e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753077.743035:0:14453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ca00/0x80c8383f484911e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753077.743057:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.743117:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753077.743183:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788753077.743329:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182711040 00000100:00100000:2.0:1788753077.743337:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182711040 00000100:00100000:2.0:1788753077.743384:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788753077.743393:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+17:14453:x1875643182711040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788753077.743405:0:14450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753077.743417:0:14450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9bb55b1400/0x80c8383f484911e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f484911e1 expref: -99 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.743440:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9bb55b1400/0x80c8383f484911e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f484911e1 expref: 18 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.743450:0:14450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9bb55b1400/0x80c8383f484911e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f484911e1 expref: 18 pid: 14450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.743457:0:14450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1400, rc 0) 00000100:00100000:2.0:1788753077.743666:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:14453:x1875643182711040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 273us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753077.743672:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788753077.743898:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788753077.743977:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ca00/0x80c8383f484911e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911e8 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753077.743986:0:14453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ca00/0x80c8383f484911e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f484911e8 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753077.744038:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.744066:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753077.744094:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baf0b9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788753077.744108:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182711168 00000100:00100000:0.0:1788753077.744112:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182711168 00000100:00100000:0.0:1788753077.744164:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788753077.744171:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+18:14453:x1875643182711168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.744707:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+18:14453:x1875643182711168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 535us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753077.744714:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788753077.744988:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.745031:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.745070:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753077.745100:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9180ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1788753077.745155:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182711296 00000100:00100000:3.0:1788753077.745161:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182711296 00000100:00100000:3.0:1788753077.745197:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788753077.745204:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:14453:x1875643182711296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788753077.745364:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cf43312c-18dc-4b92-a763-9e6fba828a91+18:14453:x1875643182711296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753077.745550:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788753077.745693:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788753077.747010:0:16685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788753077.747223:0:14453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788753077.747242:0:14453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788753077.747252:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ca00/0x80c8383f484911e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911e8 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.747263:0:14453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9a85e4ca00/0x80c8383f484911e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911e8 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788753077.747272:0:14453:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788753077.747275:0:14453:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c9bbdf68000 from 10 10000000:01000000:2.0:1788753077.747277:0:14453:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788753077.747310:0:14453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0c00/0x80c8383f484911ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.747326:0:14453:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0c00/0x80c8383f484911ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.747334:0:14453:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0c00/0x80c8383f484911ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753077.747356:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.747591:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753077.747623:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:1.0:1788753077.747691:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182711424 00000100:00100000:1.0:1788753077.747700:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182711424 00000100:00100000:1.0:1788753077.747753:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788753077.747764:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+18:14453:x1875643182711424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788753077.747976:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753077.747992:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c9b88bc8400/0x80c8383f484911f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x80c8383f484911ef expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753077.748017:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c9b88bc8400/0x80c8383f484911f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x80c8383f484911ef expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753077.748028:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c9b88bc8400/0x80c8383f484911f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x80c8383f484911ef expref: 19 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753077.748052:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8400, rc 0) 00000100:00100000:1.0:1788753077.748104:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182711424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 342us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753077.748110:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788753077.748337:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788753077.748359:0:14453:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0c00/0x80c8383f484911ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911f6 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.748537:0:14453:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0c00/0x80c8383f484911ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x80c8383f484911f6 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753077.748594:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.748623:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753077.748719:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:0.0:1788753077.749326:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182711552 00000100:00100000:0.0:1788753077.749335:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182711552 00000100:00100000:0.0:1788753077.749452:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788753077.749462:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baec64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182711552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.749750:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baec64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182711552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753077.749758:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788753077.749827:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.749877:0:14453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788753077.750041:0:14453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753077.752917:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182711680 00000100:00100000:3.0:1788753077.752930:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182711680 00000100:00100000:2.0:1788753077.753033:0:14453:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9bbe093480 going to sleep for 11 seconds 00000100:00100000:0.0:1788753077.753041:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788753077.753054:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182711680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788753077.753302:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe212850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:14453:x1875643182711680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (3259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753077.753309:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788753077.753397:0:14453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9ba1569180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cf43312c-18dc-4b92-a763-9e6fba828a91:14453:1875643182711680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788753077.755186:0:16686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788753077.755257:0:14453:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788753077.755273:0:14453:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788753077.755284:0:14453:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0c00/0x80c8383f484911ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911f6 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753077.755295:0:14453:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.105@tcp lock: ffff9c9bb55b0c00/0x80c8383f484911ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x80c8383f484911f6 expref: -99 pid: 14453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753077.866432:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788753078.382283:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753078.382605:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164899840 00000100:00100000:3.0:1788753078.382616:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164899840 00000100:00100000:3.0:1788753078.382697:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:3.0:1788753078.382709:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+6:14413:x1875643164899840:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788753078.382730:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788753078.382766:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2172400/0x80c8383f484911fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3dc expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.382846:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.382861:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.382876:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.382893:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.382901:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.382908:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788753078.383171:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788753078.383719:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031400/0x80c8383f48491212 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.383733:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031400/0x80c8383f48491212 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.383743:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031400/0x80c8383f48491212 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788753078.383769:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788753078.383774:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788753078.383809:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031400/0x80c8383f48491212 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384463:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384470:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384477:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384483:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173400 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788753078.384488:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384494:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384509:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:3.0:1788753078.384512:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788753078.384517:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384522:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173400/0x80c8383f48491204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384536:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384542:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384547:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384561:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bc2173000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788753078.384564:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384571:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384580:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c9b94cc6900) 00010000:00010000:3.0:1788753078.384582:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788753078.384585:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384591:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173000/0x80c8383f4849120b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384637:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2172400/0x80c8383f484911fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3dc expref: 8 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384652:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80031400/0x80c8383f48491212 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3dc expref: 7 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.384659:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c9b94cc6f00) 00010000:00010000:3.0:1788753078.384661:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788753078.384664:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b80031400, rc 0) 00000100:00100000:3.0:1788753078.384794:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+7:14413:x1875643164899840:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 2087us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753078.384803:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1788753078.390372:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.390456:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164900096 00000100:00100000:0.0:1788753078.390467:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164900096 00000100:00100000:0.0:1788753078.390531:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:0.0:1788753078.390543:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+7:14413:x1875643164900096:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788753078.390563:0:16034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753078.390588:0:16034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f48491219 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3e3 expref: -99 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.390664:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.390678:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.390704:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.390720:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.390728:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.390734:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391072:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d000/0x80c8383f4849122e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391082:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d000/0x80c8383f4849122e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391090:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d000/0x80c8383f4849122e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.391101:0:16034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788753078.391500:0:16034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391508:0:16034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391515:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391520:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.391529:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391537:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391549:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c9b94cc6f00) 00010000:00010000:0.0:1788753078.391552:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.391557:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391563:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491220 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391575:0:16034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391582:0:16034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391587:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391592:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.391595:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391600:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391607:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c9ba3584600) 00010000:00010000:0.0:1788753078.391609:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.391618:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.391624:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491227 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.392077:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f48491219 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3e3 expref: 10 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.392094:0:16034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d000/0x80c8383f4849122e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3e3 expref: 9 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.392102:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9ba3584000) 00010000:00010000:0.0:1788753078.392105:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.392107:0:16034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4d000, rc 0) 00000100:00100000:0.0:1788753078.393551:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14413:x1875643164900096:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 3003us (3181us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788753078.393563:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 16 00000100:00100000:2.0:1788753078.400460:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.405549:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164900224 00000100:00100000:0.0:1788753078.405564:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164900224 00000100:00100000:0.0:1788753078.405634:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:0.0:1788753078.405645:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba156b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14413:x1875643164900224:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788753078.406752:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba156b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14413:x1875643164900224:12345-192.168.203.5@tcp:59:lhsmtool_posix.0 Request processed in 1097us (6290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.406764:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 17 00000100:00100000:2.0:1788753078.454062:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753078.454099:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164900352 00000100:00100000:2.0:1788753078.454109:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164900352 00000100:00100000:2.0:1788753078.454251:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:2.0:1788753078.454261:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14419:x1875643164900352:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:2.0:1788753078.454281:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753078.454301:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f4849123c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3ea expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454437:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454453:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454527:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454545:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454553:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454560:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454737:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454746:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454759:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454765:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788753078.454770:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454779:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454791:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:2.0:1788753078.454794:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753078.454799:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454805:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491243 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454818:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454835:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454841:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454846:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788753078.454849:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454867:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454876:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c9b89426300) 00010000:00010000:2.0:1788753078.454878:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753078.454881:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454887:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f4849124a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454919:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f4849123c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3ea expref: 10 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454929:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:2.0:1788753078.454932:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753078.454936:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f4849123c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3ea expref: 10 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.454945:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0800, rc 0) 00000100:00100000:2.0:1788753078.455012:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14419:x1875643164900352:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 753us (960us total) trans 0 rc 301/301 00000100:00100000:2.0:1788753078.455020:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 18 00000100:00100000:2.0:1788753078.460287:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753078.460512:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164900480 00000100:00100000:1.0:1788753078.460521:0:14464:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164900480 00000100:00100000:1.0:1788753078.460576:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1788753078.460587:0:14464:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14419:x1875643164900480:12345-192.168.203.5@tcp:700:lfs.0 00000100:00100000:1.0:1788753078.460669:0:14464:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14419:x1875643164900480:12345-192.168.203.5@tcp:700:lfs.0 Request processed in 84us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753078.460676:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:0.0:1788753078.466091:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753078.466248:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164900736 00000100:00100000:3.0:1788753078.466269:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164900736 00000100:00100000:3.0:1788753078.466324:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 19 00000100:00100000:3.0:1788753078.466334:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14419:x1875643164900736:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:3.0:1788753078.466388:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788753078.466412:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bc2173c00/0x80c8383f4849117f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f365 expref: 9 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.466430:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:3.0:1788753078.466435:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788753078.466585:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.466597:0:14457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 5 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.466604:0:14457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.466631:0:14457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 5 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.466643:0:14457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 5 pid: 14457 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753078.466656:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14457:1875643182711808:192.168.203.5@tcp:104: 00000100:00100000:3.0:1788753078.466743:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b91432300 going to sleep for 11 seconds 00000100:00100000:0.0:1788753078.469976:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.470030:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14457:1875643182711808:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788753078.470064:0:14457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753078.470091:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164900864 00000100:00100000:0.0:1788753078.470097:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164900864 00010000:00010000:0.0:1788753078.470734:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 6 pid: 14457 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753078.470769:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:0.0:1788753078.470781:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2361:x1875643164900864:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788753078.470795:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788753078.470801:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 6 pid: 14457 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.470814:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 6 pid: 14457 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.470847:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484911b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3c7 expref: 6 pid: 14457 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.470864:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:0.0:1788753078.470869:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.470879:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.470887:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.470919:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788753078.470966:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2361:x1875643164900864:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 188us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.470973:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00080000:0.0:1788753078.470996:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788753078.471009:0:14457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.471016:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.471037:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.471047:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.471054:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.475711:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788753078.475732:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.475744:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.475752:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.475759:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.475776:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.475785:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.475802:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b94cc6300) 00010000:00010000:0.0:1788753078.475805:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.475810:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.475817:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491251 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788753078.475855:0:14457:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000005e16043 reply state 000000007fa724b7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753078.475865:0:14457:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788753078.475958:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+10:14419:x1875643164900736:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 9621us (9873us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788753078.475967:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 19 00010000:00010000:1.0:1788753078.493657:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.493675:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.493684:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.493690:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753078.493695:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.493702:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.493720:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c9ba3584600) 00010000:00010000:1.0:1788753078.493731:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788753078.493738:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.493744:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491258 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788753078.499905:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000100:00100000:0.0:1788753078.548601:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753078.548940:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164900992 00000100:00100000:2.0:1788753078.548952:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164900992 00000100:00100000:2.0:1788753078.549012:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:2.0:1788753078.549023:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+8:14427:x1875643164900992:12345-192.168.203.5@tcp:101:lctl.0 00010000:00010000:2.0:1788753078.549060:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753078.549082:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f4849125f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3f1 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.549186:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48491266 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.549200:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48491266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.549210:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48491266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788753078.549245:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788753078.549249:0:14456:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788753078.549299:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48491266 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.549323:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f4849125f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3f1 expref: 10 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.549819:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1600/0x80c8383f48491266 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3f1 expref: 9 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.549841:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:2.0:1788753078.549844:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788753078.549848:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1600, rc 0) 00000100:00100000:0.0:1788753078.550089:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14427:x1875643164900992:12345-192.168.203.5@tcp:101:lctl.0 Request processed in 1066us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.550097:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:2.0:1788753078.577441:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.577672:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164901120 00000100:00100000:0.0:1788753078.577683:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164901120 00000100:00100000:0.0:1788753078.577751:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:0.0:1788753078.577763:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:14428:x1875643164901120:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788753078.577801:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753078.577835:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f4849126d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3f8 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.577909:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d200/0x80c8383f48491274 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.577924:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d200/0x80c8383f48491274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.577935:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d200/0x80c8383f48491274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.577972:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788753078.577976:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788753078.577993:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d200/0x80c8383f48491274 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.578017:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f4849126d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3f8 expref: 7 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.578035:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d200/0x80c8383f48491274 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3f8 expref: 6 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.578044:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:0.0:1788753078.578048:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788753078.578051:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4d200, rc 0) 00000100:00100000:0.0:1788753078.578112:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+6:14428:x1875643164901120:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 351us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.578120:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 21 00000100:00100000:2.0:1788753078.580886:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.581060:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164901248 00000100:00100000:0.0:1788753078.581070:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164901248 00000100:00100000:0.0:1788753078.581229:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:0.0:1788753078.581243:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+6:14428:x1875643164901248:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788753078.581263:0:16034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753078.581282:0:16034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f4849127b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f3ff expref: -99 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581343:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581356:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581366:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581379:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581385:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581403:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581548:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491290 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581557:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581579:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.581610:0:16034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788753078.581614:0:16034:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788753078.581631:0:16034:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581642:0:16034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581648:0:16034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581655:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581661:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4da00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.581665:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581672:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581682:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:0.0:1788753078.581685:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.581690:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581695:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581721:0:16034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581727:0:16034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581732:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581737:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.581740:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581745:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581751:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c9ba3584f00) 00010000:00010000:0.0:1788753078.581754:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.581757:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581761:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f48491289 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581788:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f4849127b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3ff expref: 8 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581802:0:16034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491290 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3ff expref: 7 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.581820:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9ba3584400) 00010000:00010000:0.0:1788753078.581822:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788753078.581833:0:16034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4ce00, rc 0) 00000100:00100000:0.0:1788753078.582635:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+7:14428:x1875643164901248:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 659us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.583714:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 22 00000100:00100000:1.0:1788753078.585979:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.586623:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164901504 00000100:00100000:0.0:1788753078.586632:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164901504 00000100:00100000:0.0:1788753078.586689:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:0.0:1788753078.586699:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+7:14428:x1875643164901504:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788753078.587413:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753078.587435:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f48491297 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f406 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.587531:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788753078.587652:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f48491297 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f406 expref: 9 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.587666:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:0.0:1788753078.587669:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788753078.587674:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f48491297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f406 expref: 9 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.587688:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4d400, rc 0) 00000100:00100000:0.0:1788753078.587761:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+8:14428:x1875643164901504:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1063us (1790us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788753078.587784:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 23 00000100:00100000:2.0:1788753078.593438:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753078.593635:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164901760 00000100:00100000:1.0:1788753078.593645:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164901760 00000100:00100000:1.0:1788753078.593710:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 24 00000100:00100000:1.0:1788753078.593721:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b96b9192-cdd9-4abe-9647-995a2cd48790+8:14428:x1875643164901760:12345-192.168.203.5@tcp:36:lfs.0 00010000:00010000:1.0:1788753078.593777:0:14456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788753078.593804:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f48491290 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f3ff expref: 8 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.593836:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9ba3584400) 00010000:00010000:1.0:1788753078.593847:0:14456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788753078.593873:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.593886:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.593896:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788753078.594511:0:14456:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 00000000740f3ea5 reply state 0000000064c0595f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753078.594521:0:14456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788753078.594550:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788753078.594652:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b96b9192-cdd9-4abe-9647-995a2cd48790+9:14428:x1875643164901760:12345-192.168.203.5@tcp:36:lfs.0 Request processed in 932us (1222us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788753078.594661:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 24 00010000:00010000:3.0:1788753078.596306:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.596336:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.596344:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.596350:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788753078.596354:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.596362:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.596377:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:3.0:1788753078.596380:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788753078.596384:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.596391:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753078.602055:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753078.602181:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164902016 00000100:00100000:1.0:1788753078.602191:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164902016 00000100:00100000:1.0:1788753078.602377:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:1.0:1788753078.602388:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+8:14428:x1875643164902016:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1788753078.602649:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+9:14428:x1875643164902016:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 262us (603us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788753078.602657:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:1.0:1788753078.607157:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.607375:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164902272 00000100:00100000:0.0:1788753078.607385:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164902272 00000100:00100000:0.0:1788753078.607449:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:0.0:1788753078.607467:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+9:14428:x1875643164902272:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788753078.607493:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753078.607512:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f484912ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f40d expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.607690:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.607704:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.607716:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.607730:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.607736:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.607742:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.607853:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788753078.608350:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608373:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608379:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608384:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.608388:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608394:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608414:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:0.0:1788753078.608418:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.608422:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608428:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f484912b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608440:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608446:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608451:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608967:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4c200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.608980:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608988:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.608997:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c9ba3584f00) 00010000:00010000:0.0:1788753078.609000:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753078.609004:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.609009:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f484912ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.609057:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f484912ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f40d expref: 11 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.609067:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:0.0:1788753078.609069:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788753078.609073:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4d400/0x80c8383f484912ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f40d expref: 11 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.609082:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4d400, rc 0) 00000100:00100000:0.0:1788753078.609343:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+10:14428:x1875643164902272:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1883us (2231us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788753078.609352:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 25 00000100:00100000:0.0:1788753078.612057:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753078.612239:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164902400 00000100:00100000:1.0:1788753078.612248:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164902400 00000100:00100000:1.0:1788753078.612334:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:1.0:1788753078.612345:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+10:14428:x1875643164902400:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:1.0:1788753078.612369:0:16034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753078.612391:0:16034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484912c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f414 expref: -99 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.612495:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.612508:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.612520:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788753078.612688:0:16034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788753078.612693:0:16034:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788753078.612714:0:16034:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.612741:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484912c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 12 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.612758:0:16034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 11 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.612768:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9b8a66e600) 00010000:00010000:1.0:1788753078.612770:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788753078.612773:0:16034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9800, rc 0) 00000100:00100000:1.0:1788753078.612882:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+11:14428:x1875643164902400:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 539us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753078.612889:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 26 00000100:00100000:3.0:1788753078.621771:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.621865:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164902528 00000100:00100000:0.0:1788753078.621875:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164902528 00000100:00100000:0.0:1788753078.621940:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:0.0:1788753078.621965:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b96b9192-cdd9-4abe-9647-995a2cd48790+11:14428:x1875643164902528:12345-192.168.203.5@tcp:37:lfs.0 00000100:00100000:0.0:1788753078.627894:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b96b9192-cdd9-4abe-9647-995a2cd48790+11:14428:x1875643164902528:12345-192.168.203.5@tcp:37:lfs.0 Request processed in 5921us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.627916:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1788753078.633295:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753078.637353:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164902784 00000100:00100000:1.0:1788753078.637369:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164902784 00000100:00100000:1.0:1788753078.637617:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:1.0:1788753078.637630:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baed34850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+11:14428:x1875643164902784:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1788753078.637892:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baed34850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+12:14428:x1875643164902784:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 264us (4772us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788753078.637901:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:3.0:1788753078.693172:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753078.693281:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164902912 00000100:00100000:2.0:1788753078.693291:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164902912 00000100:00100000:2.0:1788753078.693349:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:2.0:1788753078.693358:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+9:14434:x1875643164902912:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1788753078.693392:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753078.693422:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484912d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f41b expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693663:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693677:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693689:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693702:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693708:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693714:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693807:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f484912eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693815:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f484912eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693845:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f484912eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788753078.693872:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788753078.693875:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788753078.693908:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f484912eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693919:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.693925:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694199:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694206:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788753078.694211:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694218:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694230:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:2.0:1788753078.694233:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753078.694237:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694243:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484912dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694267:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694273:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694279:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694284:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788753078.694286:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694292:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694299:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c9b89426e00) 00010000:00010000:2.0:1788753078.694301:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753078.694303:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694309:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f484912e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694342:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f484912d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f41b expref: 11 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694356:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0800/0x80c8383f484912eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f41b expref: 10 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.694854:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9b8a66e600) 00010000:00010000:2.0:1788753078.694857:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788753078.694860:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b0800, rc 0) 00000100:00100000:2.0:1788753078.695054:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+10:14434:x1875643164902912:12345-192.168.203.5@tcp:101:bash.0 Request processed in 1694us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753078.695062:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 27 00000100:00100000:2.0:1788753078.701544:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753078.701702:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164903168 00000100:00100000:1.0:1788753078.701711:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164903168 00000100:00100000:1.0:1788753078.701815:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 28 00000100:00100000:1.0:1788753078.701836:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bb57bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+10:14434:x1875643164903168:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:1.0:1788753078.701857:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753078.701877:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484912f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f422 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.702067:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.702082:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 11 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.702091:0:14456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.702210:0:14456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 11 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.702226:0:14456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 11 pid: 16034 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753078.702240:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14456:1875643182711936:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788753078.702331:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9baee45540 going to sleep for 11 seconds 00000100:00100000:2.0:1788753078.705913:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753078.706200:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164903296 00000100:00100000:3.0:1788753078.706208:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164903296 00010000:00010000:3.0:1788753078.706249:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 12 pid: 16034 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753078.706284:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1788753078.706293:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+12:2360:x1875643164903296:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788753078.706316:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788753078.706323:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 12 pid: 16034 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.706336:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 12 pid: 16034 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.706358:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9b8a66e600) 00010000:00010000:3.0:1788753078.706364:0:14442:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.706384:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.706393:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753078.706418:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788753078.706565:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+12:2360:x1875643164903296:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 271us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753078.706573:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00010000:00010000:1.0:1788753078.708248:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f484912cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f414 expref: 11 pid: 16034 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753078.708270:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14456:1875643182711936:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788753078.708294:0:14456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.708316:0:14456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.708323:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.708347:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.708359:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.708369:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711270:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711290:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711313:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788753078.711326:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788753078.711355:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711361:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711368:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711384:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753078.711388:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711396:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711439:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9b8a66e600) 00010000:00010000:1.0:1788753078.711442:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788753078.711447:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711452:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f484912f9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788753078.711838:0:14456:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 0000000089637349 reply state 00000000a0966052 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753078.711847:0:14456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788753078.711888:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9000/0x80c8383f484912f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 13 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711903:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 12 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.711910:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:1.0:1788753078.711913:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788753078.711915:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8200, rc 0) 00000100:00100000:1.0:1788753078.712028:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bb57bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+13:14434:x1875643164903168:12345-192.168.203.5@tcp:101:bash.0 Request processed in 10202us (10490us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788753078.712044:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 28 00010000:00010000:1.0:1788753078.719656:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.719672:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.719681:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.719686:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753078.719691:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.719698:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.719714:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c9b8a66e000) 00010000:00010000:1.0:1788753078.719718:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788753078.719722:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753078.719728:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8000/0x80c8383f48491300 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753078.725477:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753078.725723:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164903424 00000100:00100000:2.0:1788753078.725734:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164903424 00000100:00100000:2.0:1788753078.725796:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:2.0:1788753078.725807:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+12:14434:x1875643164903424:12345-192.168.203.5@tcp:101:bash.0 00010000:00010000:2.0:1788753078.725852:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753078.725875:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48491315 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f429 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.725974:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.725989:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.726003:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788753078.726044:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788753078.726048:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788753078.726096:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.726108:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.726177:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f48491315 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 14 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.726203:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 13 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753078.726212:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:2.0:1788753078.726214:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788753078.726218:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1a00, rc 0) 00000100:00100000:2.0:1788753078.726283:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+13:14434:x1875643164903424:12345-192.168.203.5@tcp:101:bash.0 Request processed in 477us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753078.726291:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 29 00000100:00100000:0.0:1788753078.736481:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753078.736605:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164903680 00000100:00100000:3.0:1788753078.736615:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164903680 00000100:00100000:3.0:1788753078.736668:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:3.0:1788753078.736678:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+13:14434:x1875643164903680:12345-192.168.203.5@tcp:35:bash.0 00000100:00100000:3.0:1788753078.737095:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+14:14434:x1875643164903680:12345-192.168.203.5@tcp:35:bash.0 Request processed in 417us (631us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788753078.737102:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:3.0:1788753078.839598:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.840846:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164903936 00000100:00100000:0.0:1788753078.840856:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164903936 00000100:00100000:0.0:1788753078.840919:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:0.0:1788753078.840930:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+14:14444:x1875643164903936:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788753078.840963:0:16034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753078.840984:0:16034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491323 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f430 expref: -99 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.841069:0:16034:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788753078.841205:0:16034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491323 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f430 expref: 16 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.841219:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9b89426300) 00010000:00010000:0.0:1788753078.841222:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788753078.841227:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491323 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f430 expref: 16 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.841242:0:16034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4da00, rc 0) 00000100:00100000:0.0:1788753078.841305:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+15:14444:x1875643164903936:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 378us (1744us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788753078.841311:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 30 00000100:00100000:0.0:1788753078.844979:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753078.845038:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164904192 00000100:00100000:3.0:1788753078.845048:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164904192 00000100:00100000:3.0:1788753078.845111:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:3.0:1788753078.845203:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+15:14444:x1875643164904192:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:3.0:1788753078.845469:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+16:14444:x1875643164904192:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 348us (497us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788753078.845478:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788753078.883216:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.883320:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164904448 00000100:00100000:0.0:1788753078.883330:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164904448 00000100:00100000:0.0:1788753078.883704:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 31 00000100:00100000:0.0:1788753078.883717:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+16:14447:x1875643164904448:12345-192.168.203.5@tcp:101:lfs.0 00010000:00010000:0.0:1788753078.883742:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753078.883765:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491331 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f437 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.883870:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491338 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.883885:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.883897:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491338 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753078.883908:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788753078.884725:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491331 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f437 expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.884749:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491338 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f437 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.884758:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753078.884761:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788753078.884765:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c000, rc 0) 00000100:00100000:0.0:1788753078.884840:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+18:14447:x1875643164904448:12345-192.168.203.5@tcp:101:lfs.0 Request processed in 1126us (1716us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788753078.884864:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 31 00010000:00010000:3.0:1788753078.891503:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788753078.892604:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.892742:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164904576 00000100:00100000:0.0:1788753078.892751:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164904576 00000100:00100000:0.0:1788753078.892808:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:0.0:1788753078.892818:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+18:14447:x1875643164904576:12345-192.168.203.5@tcp:54:lfs.0 00010000:00010000:0.0:1788753078.892896:0:16034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892912:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892923:0:16034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892957:0:16034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892965:0:16034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892973:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892978:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4da00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753078.892982:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892989:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.892999:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753078.893013:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788753078.893019:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.893026:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491346 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16034 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753078.893096:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+18:14447:x1875643164904576:12345-192.168.203.5@tcp:54:lfs.0 Request processed in 279us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.893104:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 32 00000100:00100000:2.0:1788753078.894353:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753078.894423:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164904704 00000100:00100000:0.0:1788753078.894431:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164904704 00000100:00100000:0.0:1788753078.894489:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:0.0:1788753078.894498:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+18:2359:x1875643164904704:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788753078.894512:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788753078.894532:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491338 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f437 expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753078.894549:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753078.894553:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788753078.894600:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+17:2359:x1875643164904704:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.894608:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:2.0:1788753078.896446:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753078.896537:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164904960 00000100:00100000:1.0:1788753078.896547:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164904960 00000100:00100000:1.0:1788753078.896596:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1788753078.896605:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+17:14447:x1875643164904960:12345-192.168.203.5@tcp:35:lfs.0 00000100:00100000:1.0:1788753078.896813:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+18:14447:x1875643164904960:12345-192.168.203.5@tcp:35:lfs.0 Request processed in 208us (374us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788753078.896842:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:0.0:1788753078.954522:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788753078.954544:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182712064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788753078.954633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753078.954895:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182712064 00000100:00100000:2.0:1788753078.954903:0:15146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182712064 00000100:00100000:2.0:1788753078.954972:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788753078.954983:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182712064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788753078.955017:0:15146:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788753078.955064:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875643182712064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753078.955087:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788753078.955115:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182712192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788753078.955165:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788753078.955198:0:16037:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182712192 00000100:00100000:2.0:1788753078.955203:0:16037:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182712192 00000100:00100000:2.0:1788753078.955225:0:16037:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788753078.955232:0:16037:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182712192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788753078.955250:0:16037:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788753078.955280:0:16037:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182712192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753078.955285:0:16037:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788753078.955338:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182712192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788753078.955369:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3303:1875643182712064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788753078.955484:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788753078.955489:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788753078.956599:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182712704:0@lo:400:kworker.0 00000100:00100000:2.0:1788753078.956611:0:3306:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182712320:0@lo:400:kworker.0 00000100:00100000:2.0:1788753078.956670:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753078.956671:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788753078.956733:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182712704 00000100:00100000:0.0:1788753078.956740:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182712704 00000100:00100000:1.0:1788753078.956751:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182712448:0@lo:400:kworker.0 00000100:00100000:1.0:1788753078.956782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753078.956805:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788753078.956810:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182712576:0@lo:400:kworker.0 00000100:00100000:1.0:1788753078.956842:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788753078.956933:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788753078.956966:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182712448 00000100:00100000:0.0:1788753078.956971:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182712448 00000100:00100000:0.0:1788753078.957004:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788753078.957013:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182712704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753078.957076:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875643182712704:12345-0@lo:400:kworker.0 Request processed in 65us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.957084:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788753078.957108:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788753078.957115:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182712448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788753078.957173:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875643182712448:12345-0@lo:400:kworker.0 Request processed in 58us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753078.957179:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788753078.957225:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3305:1875643182712704:0@lo:400:kworker.0 00000100:00100000:3.0:1788753078.957296:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182712320 00000100:00100000:3.0:1788753078.957300:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182712320 00000100:00100000:3.0:1788753078.957337:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788753078.957344:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3306:x1875643182712320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788753078.957385:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe211450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cf43312c-18dc-4b92-a763-9e6fba828a91+19:3306:x1875643182712320:12345-0@lo:400:kworker.0 Request processed in 41us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753078.957396:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788753078.957438:0:3306:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cf43312c-18dc-4b92-a763-9e6fba828a91:3306:1875643182712320:0@lo:400:kworker.0 00000100:00100000:2.0:1788753078.957649:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182712576 00000100:00100000:2.0:1788753078.957654:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182712576 00000100:00100000:1.0:1788753078.957678:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875643182712448:0@lo:400:kworker.0 00000100:00100000:2.0:1788753078.957849:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788753078.957856:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182712576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788753078.957898:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875643182712576:12345-0@lo:400:kworker.0 Request processed in 43us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753078.957904:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788753078.958001:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3303:1875643182712576:0@lo:400:kworker.0 00000100:00080000:3.0:1788753078.958038:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788753079.148507:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788753079.167663:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753079.171676:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164905216 00000100:00100000:0.0:1788753079.171695:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164905216 00000100:00100000:0.0:1788753079.171873:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:0.0:1788753079.171884:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+18:14478:x1875643164905216:12345-192.168.203.5@tcp:101:cat.0 00010000:00010000:0.0:1788753079.171907:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753079.171928:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f4849134d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f43e expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.172024:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491354 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.172038:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491354 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.172062:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491354 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753079.172075:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788753079.172261:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f4849134d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f43e expref: 21 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.172280:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491354 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f43e expref: 20 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.172288:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753079.172291:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788753079.172294:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4da00, rc 0) 00000100:00100000:0.0:1788753079.172368:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+20:14478:x1875643164905216:12345-192.168.203.5@tcp:101:cat.0 Request processed in 485us (4714us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788753079.172375:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 33 00000100:00100000:2.0:1788753079.179548:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753079.180115:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753079.180487:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164905600 00000100:00100000:0.0:1788753079.180501:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164905600 00000100:00100000:1.0:1788753079.180615:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164905472 00000100:00100000:1.0:1788753079.180625:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164905472 00000100:00100000:0.0:1788753079.180657:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:0.0:1788753079.180672:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+21:2360:x1875643164905600:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788753079.180691:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788753079.180696:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:1.0:1788753079.180711:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+21:14478:x1875643164905472:12345-192.168.203.5@tcp:35:cat.0 00010000:00010000:0.0:1788753079.180721:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491354 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f43e expref: 21 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.180742:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753079.180747:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788753079.182449:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+21:2360:x1875643164905600:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 1763us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753079.182463:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:1.0:1788753079.182557:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+20:14478:x1875643164905472:12345-192.168.203.5@tcp:35:cat.0 Request processed in 1843us (3019us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788753079.182569:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 8 00000100:00100000:2.0:1788753079.254687:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753079.260663:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164905856 00000100:00100000:0.0:1788753079.260679:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164905856 00000100:00100000:0.0:1788753079.260770:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:0.0:1788753079.260781:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+20:14484:x1875643164905856:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:0.0:1788753079.260807:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753079.260837:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491362 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f445 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.260950:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.260966:0:14457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 21 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.260974:0:14457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 21 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.260981:0:14457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.261011:0:14457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 21 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.261024:0:14457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 21 pid: 14455 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753079.261053:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14457:1875643182712832:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788753079.261184:0:14457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 21 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.261193:0:14457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 21 pid: 14456 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753079.261201:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14457:1875643182712960:192.168.203.5@tcp:104: 00000100:00100000:0.0:1788753079.261223:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9ba0ed5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788753079.265599:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753079.265719:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164905984 00000100:00100000:1.0:1788753079.265729:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164905984 00010000:00010000:1.0:1788753079.265780:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 22 pid: 14455 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753079.265829:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1788753079.265840:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9b88adec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+22:2361:x1875643164905984:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788753079.265868:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788753079.265875:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 22 pid: 14455 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.265888:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 22 pid: 14455 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.265922:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:1.0:1788753079.265927:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.265936:0:14440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.265943:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788753079.265996:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9b88adec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+22:2361:x1875643164905984:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 158us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753079.266003:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:3.0:1788753079.266936:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753079.266992:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164906112 00000100:00100000:3.0:1788753079.267003:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164906112 00010000:00010000:3.0:1788753079.267054:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 22 pid: 14456 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753079.267099:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1788753079.267162:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+22:2361:x1875643164906112:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788753079.267179:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788753079.267187:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 22 pid: 14456 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.267202:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 22 pid: 14456 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.267229:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:3.0:1788753079.267235:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.267247:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.267255:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.267278:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788753079.267339:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+22:2361:x1875643164906112:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 213us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753079.267347:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00010000:00010000:0.0:1788753079.267869:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f4849131c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f429 expref: 21 pid: 14455 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753079.267894:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14457:1875643182712832:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788753079.267909:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8200/0x80c8383f48491307 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f422 expref: 20 pid: 14456 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753079.267919:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14457:1875643182712960:192.168.203.5@tcp:104: 00010000:00010000:0.0:1788753079.267945:0:14457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.267955:0:14457:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.267961:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753079.268004:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788753079.268508:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491362 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f445 expref: 21 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.268525:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c000/0x80c8383f48491369 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f445 expref: 20 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.268533:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753079.268535:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788753079.268538:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c000, rc 0) 00000100:00100000:1.0:1788753079.268659:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+20:14484:x1875643164905856:12345-192.168.203.5@tcp:101:dd.0 Request processed in 7878us (13978us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788753079.268668:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 34 00000100:00100000:3.0:1788753079.272675:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753079.272895:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164906368 00000100:00100000:1.0:1788753079.272909:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164906368 00000100:00100000:1.0:1788753079.273042:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 35 00000100:00100000:1.0:1788753079.273055:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+20:14484:x1875643164906368:12345-192.168.203.5@tcp:36:dd.0 00010000:00010000:1.0:1788753079.273477:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.273524:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.273540:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788753079.273606:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788753079.273640:0:14455:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000008bbb114c reply state 00000000f68a4f2f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753079.273651:0:14455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788753079.274590:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14484:x1875643164906368:12345-192.168.203.5@tcp:36:dd.0 Request processed in 1529us (1921us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788753079.274602:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 35 00000020:00080000:1.0:1788753079.274611:0:14455:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788753079.279418:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753079.279514:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164906496 00000100:00100000:0.0:1788753079.279529:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164906496 00000100:00100000:0.0:1788753079.279602:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 36 00000100:00100000:0.0:1788753079.279615:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14484:x1875643164906496:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:0.0:1788753079.279653:0:16034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753079.279684:0:16034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f4849137e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f44c expref: -99 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.279779:0:16034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f4849137e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f44c expref: 24 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.279796:0:16034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f4849137e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f44c expref: 24 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.279828:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753079.279832:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788753079.279857:0:16034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c200, rc 0) 00000100:00100000:0.0:1788753079.279941:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+24:14484:x1875643164906496:12345-192.168.203.5@tcp:101:dd.0 Request processed in 327us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753079.279950:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 36 00010000:00010000:3.0:1788753079.280455:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.280474:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.280483:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.280507:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:3.0:1788753079.280512:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.280521:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.280540:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:3.0:1788753079.280544:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788753079.280550:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753079.280556:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8a00/0x80c8383f48491377 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753079.296445:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753079.296604:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164906752 00000100:00100000:1.0:1788753079.296614:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164906752 00000100:00100000:1.0:1788753079.296683:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:1.0:1788753079.296694:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14484:x1875643164906752:12345-192.168.203.5@tcp:103:dd.0 00010000:00010000:1.0:1788753079.296710:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788753079.296737:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c200/0x80c8383f4849137e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f44c expref: 23 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.296760:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:1.0:1788753079.296765:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788753079.296832:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+22:14484:x1875643164906752:12345-192.168.203.5@tcp:103:dd.0 Request processed in 140us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753079.296839:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:2.0:1788753079.299774:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753079.299905:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164906880 00000100:00100000:0.0:1788753079.299922:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164906880 00000100:00100000:0.0:1788753079.300009:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:0.0:1788753079.300021:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+22:14484:x1875643164906880:12345-192.168.203.5@tcp:58:dd.0 00010000:00010000:0.0:1788753079.300183:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.300205:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753079.300221:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788753079.302606:0:14456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788753079.302795:0:14456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788753079.302886:0:14456:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788753079.303038:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+22:14484:x1875643164906880:12345-192.168.203.5@tcp:58:dd.0 Request processed in 3012us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753079.303052:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 37 00000100:00100000:2.0:1788753079.306317:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753079.307054:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164907008 00000100:00100000:1.0:1788753079.307073:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164907008 00000100:00100000:1.0:1788753079.307190:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 38 00000100:00100000:1.0:1788753079.307204:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+22:14484:x1875643164907008:12345-192.168.203.5@tcp:101:dd.0 00010000:00010000:1.0:1788753079.307231:0:16034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753079.307259:0:16034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f453 expref: -99 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.307333:0:16034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.307346:0:16034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f453 expref: 23 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.307370:0:16034:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.307385:0:16034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f453 expref: 23 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.307400:0:16034:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:1.0:1788753079.308211:0:16034:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788753079.308219:0:16034:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f453 expref: 23 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753079.308231:0:16034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9800, rc 0) 00000100:00100000:1.0:1788753079.308359:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14484:x1875643164907008:12345-192.168.203.5@tcp:101:dd.0 Request processed in 1158us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753079.308368:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 38 00010000:00010000:3.0:1788753079.917356:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788753080.170460:0:14489:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788753080.170473:0:14489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788753080.170546:0:14489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788753080.170555:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788753080.171101:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf56300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14489:1875643182713088:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788753080.171274:0:14489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b9081ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788753080.175999:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf56300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14489:1875643182713088:192.168.203.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788753080.185588:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.185898:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164907136 00000100:00100000:3.0:1788753080.185916:0:14466:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164907136 00000100:00100000:3.0:1788753080.186005:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:3.0:1788753080.186018:0:14466:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14487:x1875643164907136:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788753080.186167:0:14466:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14487:x1875643164907136:12345-192.168.203.5@tcp:900:lhsmtool_posix.0 Request processed in 151us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753080.186175:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00080000:2.0:1788753080.186437:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788753080.189666:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.189911:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164907264 00000100:00100000:1.0:1788753080.189924:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164907264 00000100:00100000:1.0:1788753080.190054:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:1.0:1788753080.190065:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14487:x1875643164907264:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788753080.190109:0:14455:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788753080.190272:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14487:x1875643164907264:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 208us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.190280:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 39 00000100:00100000:1.0:1788753080.195025:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753080.195112:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164907392 00000100:00100000:2.0:1788753080.195151:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164907392 00000100:00100000:2.0:1788753080.195223:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:2.0:1788753080.195235:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14487:x1875643164907392:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788753080.195333:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.195355:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.195371:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.196804:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.196850:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.196865:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.196899:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.196909:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.196916:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788753080.196965:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788753080.196970:0:14457:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788753080.196987:0:14457:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.196999:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197005:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197013:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197019:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788753080.197023:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197037:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197049:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9ba3584000) 00010000:00010000:2.0:1788753080.197052:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753080.197056:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197061:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1a00/0x80c8383f48491393 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197076:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197081:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197086:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197091:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0000 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788753080.197093:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197098:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197105:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c9b89426e00) 00010000:00010000:2.0:1788753080.197107:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753080.197109:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197150:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b0000/0x80c8383f4849139a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197168:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197174:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197180:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197185:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:2.0:1788753080.197188:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197194:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197201:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:2.0:1788753080.197204:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788753080.197206:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.197211:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9bb55b1e00/0x80c8383f484913a1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753080.197311:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14487:x1875643164907392:12345-192.168.203.5@tcp:34:lhsmtool_posix.0 Request processed in 2072us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753080.197321:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 40 00000100:00100000:2.0:1788753080.200146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753080.200276:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164907648 00000100:00100000:0.0:1788753080.200292:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164907648 00000100:00100000:0.0:1788753080.200373:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:0.0:1788753080.200386:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+23:14487:x1875643164907648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788753080.200425:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753080.200484:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f484913a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f45a expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200621:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200639:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200652:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788753080.200667:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788753080.200803:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200811:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200829:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200836:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4ce00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753080.200841:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200849:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200863:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:0.0:1788753080.200866:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788753080.200871:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200887:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200946:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f484913a8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f45a expref: 25 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200957:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c9ba3584000) 00010000:00010000:0.0:1788753080.200960:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788753080.200963:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f484913a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f45a expref: 25 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.200972:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4c800, rc 0) 00000100:00100000:0.0:1788753080.201058:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+24:14487:x1875643164907648:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 675us (941us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788753080.201067:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 41 00000100:00100000:0.0:1788753080.207498:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.207606:0:16034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164907776 00000100:00100000:1.0:1788753080.207620:0:16034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164907776 00000100:00100000:1.0:1788753080.207695:0:16034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:1.0:1788753080.207707:0:16034:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+24:14487:x1875643164907776:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788753080.207757:0:16034:0:(mdt_handler.c:8170:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788753080.207927:0:16034:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+24:14487:x1875643164907776:12345-192.168.203.5@tcp:53:lhsmtool_posix.0 Request processed in 222us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.207936:0:16034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 42 00000100:00100000:2.0:1788753080.212723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753080.212839:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164908032 00000100:00100000:0.0:1788753080.212849:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164908032 00000100:00100000:0.0:1788753080.212906:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:0.0:1788753080.212916:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+24:14487:x1875643164908032:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788753080.213037:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788753080.213058:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f484913bd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f461 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788753080.220305:0:14456:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:0.0:1788753080.220319:0:14456:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788753080.220378:0:14456:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788753080.220679:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.220697:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.220709:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.220781:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4c800/0x80c8383f484913bd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f461 expref: 27 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.220801:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f461 expref: 26 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.220811:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9ba3584f00) 00010000:00010000:0.0:1788753080.220828:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788753080.220831:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9a85e4ce00, rc 0) 00000100:00100000:0.0:1788753080.220912:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+26:14487:x1875643164908032:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 7997us (8197us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788753080.220921:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 43 00000100:00100000:2.0:1788753080.228205:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.228289:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164908288 00000100:00100000:1.0:1788753080.228299:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164908288 00000100:00100000:1.0:1788753080.228355:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:1.0:1788753080.228367:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+26:14487:x1875643164908288:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788753080.228426:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788753080.228454:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4ce00/0x80c8383f484913c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f461 expref: 26 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228477:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9ba3584f00) 00010000:00010000:1.0:1788753080.228502:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788753080.228529:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228543:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228552:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228565:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228571:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228577:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228636:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228643:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228649:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228656:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753080.228660:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228667:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228684:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c9b8a66e600) 00010000:00010000:1.0:1788753080.228686:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788753080.228691:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228698:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913d2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228708:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228714:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228720:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228725:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753080.228729:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228734:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228741:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1fedd236 (ffff9c9b8a66e000) 00010000:00010000:1.0:1788753080.228744:0:14457:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788753080.228747:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.228754:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913d9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1fedd236 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.228854:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+25:14487:x1875643164908288:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 489us (659us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788753080.228861:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 44 00000100:00100000:2.0:1788753080.231310:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.231387:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164908416 00000100:00100000:1.0:1788753080.231397:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164908416 00000100:00100000:1.0:1788753080.231454:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:1.0:1788753080.231464:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+25:14487:x1875643164908416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788753080.231485:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753080.231505:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913e0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f468 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.231540:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8c00/0x80c8383f484913e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.231552:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8c00/0x80c8383f484913e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.231563:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8c00/0x80c8383f484913e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.231663:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913e0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f468 expref: 27 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.231683:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8c00/0x80c8383f484913e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f468 expref: 26 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.231691:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:1.0:1788753080.231698:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788753080.231701:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc8c00, rc 0) 00000100:00100000:1.0:1788753080.231753:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+26:14487:x1875643164908416:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 290us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.231760:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 45 00000100:00100000:2.0:1788753080.234542:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.235895:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164908672 00000100:00100000:1.0:1788753080.235910:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164908672 00000100:00100000:1.0:1788753080.235970:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 46 00000100:00100000:1.0:1788753080.235980:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+26:14487:x1875643164908672:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788753080.236063:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.236079:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.236090:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788753080.236544:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1788753080.236555:0:14457:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 479970431523ns, next at 480970429332ns, rc = 0 00000004:00010000:1.0:1788753080.236641:0:14457:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000003f74f914 reply state 000000001fefa364 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.236651:0:14457:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788753080.236762:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+28:14487:x1875643164908672:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 781us (2231us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788753080.236770:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 46 00010000:00010000:1.0:1788753080.239396:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.239431:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.239440:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.239447:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8e00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753080.239451:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.239459:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.239476:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:1.0:1788753080.239479:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788753080.239484:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.239490:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8e00/0x80c8383f484913ee lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753080.242547:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.243914:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164908800 00000100:00100000:1.0:1788753080.243930:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164908800 00000100:00100000:1.0:1788753080.244005:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:1.0:1788753080.244016:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+27:14487:x1875643164908800:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788753080.244040:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753080.244061:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f46f expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.244169:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 28 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.244183:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 28 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.244200:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:1.0:1788753080.244203:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788753080.244206:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9200, rc 0) 00000100:00100000:1.0:1788753080.244259:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+28:14487:x1875643164908800:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 246us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.244265:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 47 00000100:00100000:2.0:1788753080.248651:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.248755:0:16038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164908928 00000100:00100000:3.0:1788753080.248768:0:16038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164908928 00000100:00100000:3.0:1788753080.248871:0:16038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:3.0:1788753080.248885:0:16038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2361:x1875643164908928:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788753080.249398:0:16038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2361:x1875643164908928:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 514us (760us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788753080.249430:0:16038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00080000:2.0:1788753080.250565:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788753080.252576:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.252720:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164909184 00000100:00100000:3.0:1788753080.252732:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164909184 00000100:00100000:3.0:1788753080.252806:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:3.0:1788753080.252826:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+28:14487:x1875643164909184:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788753080.253335:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+29:14487:x1875643164909184:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 516us (770us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788753080.253343:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 9 00000100:00100000:1.0:1788753080.255951:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753080.257221:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164909440 00000100:00100000:2.0:1788753080.257239:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164909440 00000100:00100000:2.0:1788753080.257327:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:2.0:1788753080.257339:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+29:14487:x1875643164909440:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788753080.257513:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+29:14487:x1875643164909440:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 175us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753080.257520:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 48 00000100:00100000:2.0:1788753080.260990:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.263070:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164909568 00000100:00100000:1.0:1788753080.263093:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164909568 00000100:00100000:1.0:1788753080.263201:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:1.0:1788753080.263214:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+29:14487:x1875643164909568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788753080.263248:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788753080.263282:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913fc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f476 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.263379:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9a00/0x80c8383f48491403 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.263407:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9a00/0x80c8383f48491403 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.263457:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9a00/0x80c8383f48491403 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788753080.263509:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788753080.263533:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9a00/0x80c8383f48491403 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.263564:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f484913fc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f476 expref: 31 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.263963:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9a00/0x80c8383f48491403 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f476 expref: 30 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.263974:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:1.0:1788753080.263976:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788753080.263981:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9b88bc9a00, rc 0) 00000100:00100000:1.0:1788753080.264236:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+30:14487:x1875643164909568:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 1023us (3257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.264246:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 49 00000100:00100000:0.0:1788753080.267549:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753080.267713:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164909696 00000100:00100000:2.0:1788753080.267726:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164909696 00000100:00100000:2.0:1788753080.267833:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:2.0:1788753080.267845:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+6:2360:x1875643164909696:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788753080.267869:0:15141:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788753080.267895:0:15141:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xbb696684d852f47d expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788753080.267927:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9e34b8, blocks: 0x1 00010000:00010000:2.0:1788753080.267950:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:2.0:1788753080.267970:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753080.267980:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 7 pid: 15141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.268004:0:15141:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 7 pid: 15141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.268029:0:15141:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9bb55b1e00, rc 0) 00000100:00100000:2.0:1788753080.268103:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+7:2360:x1875643164909696:12345-192.168.203.5@tcp:101:lhsmtool_posix.0 Request processed in 260us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753080.268110:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:3.0:1788753080.270594:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753080.270755:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164909952 00000100:00100000:0.0:1788753080.270767:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164909952 00000100:00100000:0.0:1788753080.270847:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:0.0:1788753080.270858:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+30:14487:x1875643164909952:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788753080.270986:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+30:14487:x1875643164909952:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 130us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753080.271025:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 50 00000100:00100000:3.0:1788753080.273695:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.273740:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164910080 00000100:00100000:3.0:1788753080.273751:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164910080 00000100:00100000:3.0:1788753080.273810:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1788753080.273834:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+30:14487:x1875643164910080:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788753080.317411:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1788753080.317485:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788753080.317497:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1788753080.317501:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788753080.317532:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788753080.317542:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:3.0:1788753080.317796:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788753080.317833:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9bbdf5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182713216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788753080.317921:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788753080.318006:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182713216 00000100:00100000:3.0:1788753080.318015:0:15144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182713216 00000100:00100000:3.0:1788753080.318082:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788753080.318094:0:15144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875643182713216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788753080.318315:0:15144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788753080.318319:0:15144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788753080.318322:0:15144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788753080.318324:0:15144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788753080 -> 1788753080 00002000:00010000:3.0:1788753080.318340:0:15144:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788753080.318383:0:15144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875643182713216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 291us (461us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788753080.318392:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788753080.318724:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788753080.318764:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c9bbdf5d180/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788753080.318771:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9bbdf5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3305:1875643182713216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788753080.319023:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+14:14487:x1875643164910080:12345-192.168.203.5@tcp:44:lhsmtool_posix.0 Request processed in 45189us (45338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753080.319034:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 51 00000100:00100000:3.0:1788753080.321396:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.321870:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164910208 00000100:00100000:1.0:1788753080.321882:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164910208 00000100:00100000:1.0:1788753080.321998:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1788753080.322029:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+7:2360:x1875643164910208:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788753080.322200:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+7:2360:x1875643164910208:12345-192.168.203.5@tcp:16:lhsmtool_posix.0 Request processed in 173us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.322208:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:0.0:1788753080.324253:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.324343:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164910464 00000100:00100000:3.0:1788753080.324355:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164910464 00000100:00100000:3.0:1788753080.324432:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1788753080.324444:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+14:14487:x1875643164910464:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788753080.324525:0:14457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788753080.324563:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9a00/0x80c8383f48491403 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f476 expref: 14 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.324588:0:14457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:3.0:1788753080.324594:0:14457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788753080.324634:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.324652:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.324664:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788753080.324936:0:14457:0:(mdt_handler.c:4682:mdt_save_lock()) ### save lock request 000000009f451b80 reply state 00000000b627cacb transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753080.324985:0:14457:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788753080.325108:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+15:14487:x1875643164910464:12345-192.168.203.5@tcp:36:lhsmtool_posix.0 Request processed in 665us (865us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788753080.325116:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 52 00000100:00100000:3.0:1788753080.327696:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753080.327955:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164910592 00000100:00100000:2.0:1788753080.327968:0:15144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164910592 00000100:00100000:2.0:1788753080.328176:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:2.0:1788753080.328188:0:15144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+7:2361:x1875643164910592:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1788753080.328301:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.328315:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.328323:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.328330:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b80030800 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:0.0:1788753080.328335:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.328343:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.328361:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:0.0:1788753080.328364:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788753080.328369:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.328374:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b80030800/0x80c8383f48491411 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14457 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788753080.328557:0:15144:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788753080.328561:0:15144:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788753079 00002000:00010000:2.0:1788753080.328564:0:15144:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788753079 00002000:00010000:2.0:1788753080.328566:0:15144:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788753080 -> 1788753079 00002000:00010000:2.0:1788753080.328569:0:15144:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788753080.328642:0:15144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+8:2361:x1875643164910592:12345-192.168.203.5@tcp:2:lhsmtool_posix.0 Request processed in 456us (960us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788753080.328651:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:3.0:1788753080.330241:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753080.330667:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164910720 00000100:00100000:2.0:1788753080.330679:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164910720 00000100:00100000:2.0:1788753080.330758:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:2.0:1788753080.330769:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+8:2361:x1875643164910720:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788753080.331203:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331223:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753080.331228:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753080.331235:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331251:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331284:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331292:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331300:0:15141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331307:0:15141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753080.331312:0:15141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331320:0:15141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331349:0:15141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.331356:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491418 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753080.331563:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+8:2361:x1875643164910720:12345-192.168.203.5@tcp:1:lhsmtool_posix.0 Request processed in 795us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753080.331578:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 15 00000100:00100000:0.0:1788753080.334605:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.334728:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164910976 00000100:00100000:1.0:1788753080.334741:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164910976 00000100:00100000:1.0:1788753080.334848:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 53 00000100:00100000:1.0:1788753080.334861:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+14:14487:x1875643164910976:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788753080.334964:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.335053:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.335069:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.335645:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.335661:0:14455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 15 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.335671:0:14455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.335715:0:14455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 15 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.335746:0:14455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 15 pid: 14455 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.335763:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14455:1875643182713344:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788753080.335949:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788753080.341793:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:2.0:1788753080.341859:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164911104 00000100:00100000:2.0:1788753080.341871:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164911104 00010000:00010000:2.0:1788753080.341927:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 16 pid: 14455 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753080.341972:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:2.0:1788753080.341993:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+16:2360:x1875643164911104:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788753080.342011:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788753080.342019:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 16 pid: 14455 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.342035:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 16 pid: 14455 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.342062:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:2.0:1788753080.342068:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.342096:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.342104:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.342146:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788753080.342496:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f484913f5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f46f expref: 16 pid: 14455 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.342515:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14455:1875643182713344:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788753080.342541:0:14455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.342550:0:14455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.342556:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788753080.342806:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788753080.343252:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788753080.343307:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788753080.343414:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14455:1875643182713472:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788753080.345050:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753080.345180:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182713472 00000100:00100000:1.0:1788753080.345189:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182713472 00000100:00100000:1.0:1788753080.345427:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788753080.345428:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+18:2360:x1875643164911104:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 3432us (3633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.345442:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9ba1569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14455:x1875643182713472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788753080.345455:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 13 00000100:00100000:1.0:1788753080.345616:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9ba1569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14455:x1875643182713472:12345-0@lo:1000:mdt00_000.0 Request processed in 178us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753080.345624:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788753080.345658:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788753080.345686:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14455:1875643182713472:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788753080.348887:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788753080.348982:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14455:1875643182713600:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788753080.349059:0:14455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788753080.349205:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788753080.351515:0:14460:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643182713600 00000100:00100000:2.0:1788753080.351530:0:14460:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643182713600 00000100:00100000:2.0:1788753080.351594:0:14460:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788753080.351605:0:14460:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14455:x1875643182713600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788753080.351931:0:14460:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14455:x1875643182713600:12345-0@lo:1000:mdt00_000.0 Request processed in 327us (2870us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788753080.351938:0:14460:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788753080.352628:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9a85e03480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14455:1875643182713600:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788753080.352674:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352685:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352693:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352700:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8600 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753080.352705:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352714:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352733:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:1.0:1788753080.352737:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788753080.352759:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352767:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491426 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352826:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352832:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352838:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352844:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4da00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753080.352846:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352852:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352860:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:1.0:1788753080.352863:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788753080.352870:0:14455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f453 expref: 18 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352884:0:14455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f453 expref: 18 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352894:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f453 expref: 18 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.352977:0:14455:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9800/0x80c8383f4849138c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f453 expref: 18 pid: 16034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.352992:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14455:1875643182713728:192.168.203.5@tcp:105: 00000100:00100000:1.0:1788753080.353084:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9a8428fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788753080.356619:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.356662:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14455:1875643182713728:192.168.203.5@tcp:105: 00000100:00100000:0.0:1788753080.356688:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164911232 00000100:00100000:0.0:1788753080.356697:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164911232 00010000:00010000:1.0:1788753080.356703:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356714:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9a85e4da00/0x80c8383f48491385 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356748:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356762:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356773:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356783:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356789:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356796:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356838:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9200 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753080.356843:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356850:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356862:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:1.0:1788753080.356865:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788753080.356868:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356874:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9200/0x80c8383f4849142d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356885:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356891:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753080.356897:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00010000:00010000:1.0:1788753080.356902:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356914:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc1f2c4f0) 00010000:00010000:1.0:1788753080.356920:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753080.356923:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baed37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+19:14484:x1875643164911232:12345-192.168.203.5@tcp:49:dd.0 00010000:00010000:1.0:1788753080.356928:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356949:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c9b8a66e200) 00010000:00010000:1.0:1788753080.356951:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788753080.356955:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.356960:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc9c00/0x80c8383f4849141f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753080.357074:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baed37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+19:14484:x1875643164911232:12345-192.168.203.5@tcp:49:dd.0 Request processed in 161us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788753080.357083:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000040:00080000:1.0:1788753080.357260:0:14489:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788753080.357265:0:14489:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788753080.357292:0:14489:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788753080.357297:0:14489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788753080.357360:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+18:14487:x1875643164910976:12345-192.168.203.5@tcp:57:lhsmtool_posix.0 Request processed in 22501us (22767us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788753080.357380:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 53 00000020:00080000:1.0:1788753080.357384:0:14455:0:(tgt_main.c:545:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788753080.359688:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753080.361872:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164911488 00000100:00100000:0.0:1788753080.361885:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164911488 00000100:00100000:1.0:1788753080.363115:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1788753080.363151:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+18:14487:x1875643164911488:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788753080.364116:0:14458:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788753080.364250:0:14458:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788753080.364299:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.364316:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.364328:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.364351:0:14458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.364359:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.364365:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.364396:0:14458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788753080.364463:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788753080.364474:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.364484:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:0.0:1788753080.364488:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.364499:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.364513:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c9b8a66eb00) 00010000:00010000:0.0:1788753080.364517:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788753080.364522:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.364527:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9b88bc8600/0x80c8383f48491434 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.364541:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753080.364543:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788753080.364545:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788753080.364746:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+20:14487:x1875643164911488:12345-192.168.203.5@tcp:35:lhsmtool_posix.0 Request processed in 1600us (5062us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788753080.364756:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000020:00080000:1.0:1788753080.364762:0:14458:0:(tgt_main.c:545:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788753080.532771:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753080.532839:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.532949:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164911616 00000100:00100000:1.0:1788753080.532958:0:15147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164911616 00000100:00100000:1.0:1788753080.533023:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164911744 00000100:00100000:1.0:1788753080.533027:0:15147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164911744 00000100:00100000:1.0:1788753080.533050:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1788753080.533063:0:15147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+9:2361:x1875643164911616:12345-192.168.203.5@tcp:4:dd.0 00010000:00010000:1.0:1788753080.533100:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.533152:0:15147:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 9 pid: 15141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.533163:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.533169:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.533187:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.533225:0:15147:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 9 pid: 15141 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.533239:0:15147:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 9 pid: 15141 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.533253:0:15147:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c9baef1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15147:1875643182713856:192.168.203.5@tcp:104: 00000100:00100000:1.0:1788753080.533466:0:15147:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c9b87351c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788753080.535438:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.535732:0:15149:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788753080.535748:0:15149:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788753080.536516:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164911872 00000100:00100000:3.0:1788753080.536530:0:15149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164911872 00000100:00100000:1.0:1788753080.537730:0:16689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 1 00000100:00100000:1.0:1788753080.537753:0:16689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a85e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+10:2361:x1875643164911744:12345-192.168.203.5@tcp:4:dd.0 00010000:00010000:1.0:1788753080.537799:0:16689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.537827:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.537832:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.537836:0:16689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.537847:0:16689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788753080.538042:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.538181:0:15147:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c9baef1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15147:1875643182713856:192.168.203.5@tcp:104: 00010000:00010000:1.0:1788753080.538205:0:15147:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753080.540975:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912000 00000100:00100000:2.0:1788753080.540991:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912000 00010000:00010000:3.0:1788753080.544401:0:14442:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 11 pid: 15141 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753080.544504:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 14 00000100:00100000:3.0:1788753080.544515:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+11:2361:x1875643164912000:12345-192.168.203.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788753080.544530:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788753080.544551:0:14442:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 11 pid: 15141 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.544566:0:14442:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 11 pid: 15141 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.544590:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3aa2db7/0x80c8383f4849140a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.5@tcp remote: 0xbb696684d852f47d expref: 11 pid: 15141 timeout: 580 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.544628:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788753080.544632:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788753080.544639:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.544649:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.544659:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788753080.544661:0:14442:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788753080.544665:0:14442:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.544672:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.544788:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788753080.544856:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf57800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+10:2361:x1875643164912000:12345-192.168.203.5@tcp:103:ldlm_bl.0 Request processed in 343us (6814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753080.544864:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 14 00010000:00010000:2.0:1788753080.545070:0:16689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.545331:0:15147:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.545344:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.545598:0:16689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788753080.642578:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1788753080.642624:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:1.0:1788753080.643509:0:15147:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1788753080.643515:0:15147:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788753079 -> 1788753080 00002000:00010000:1.0:1788753080.643517:0:15147:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1788753080.643531:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643544:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643554:0:15147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643562:0:15147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9c00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753080.643567:0:15147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643574:0:15147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643593:0:15147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643600:0:15147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb205e/0x80c8383f4849143b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.643693:0:15147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+10:2361:x1875643164911616:12345-192.168.203.5@tcp:4:dd.0 Request processed in 110629us (110929us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1788753080.643714:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 0 00000100:00100000:1.0:1788753080.643746:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 2 00000100:00100000:1.0:1788753080.643760:0:15147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbde21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+9:2360:x1875643164911872:12345-192.168.203.5@tcp:4:dd.0 00010000:00010000:1.0:1788753080.643795:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643819:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.643824:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.643829:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.643840:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788753080.696710:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1788753080.696886:0:16689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:3.0:1788753080.696892:0:16689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:3.0:1788753080.696911:0:16689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.696941:0:16689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.696950:0:16689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.696956:0:16689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753080.696961:0:16689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.696969:0:16689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.696988:0:16689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.696996:0:16689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cee14b10/0x80c8383f48491442 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753080.697077:0:16689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a85e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:472192c3-7fea-4fd7-bf59-65fb04537d51+9:2361:x1875643164911744:12345-192.168.203.5@tcp:4:dd.0 Request processed in 159328us (164232us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788753080.697089:0:16689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 1 00002000:00010000:3.0:1788753080.740158:0:15147:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788753080.740183:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.740219:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.740229:0:15147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.740237:0:15147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9400 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753080.740242:0:15147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.740251:0:15147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.740273:0:15147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.740280:0:15147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093790c46/0x80c8383f48491449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753080.740383:0:15147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbde21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+7:2360:x1875643164911872:12345-192.168.203.5@tcp:4:dd.0 Request processed in 96623us (204946us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788753080.740393:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 2 00000001:00080000:0.0:1788753080.740505:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:3.0:1788753080.745190:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:1.0:1788753080.747517:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912128 00000100:00100000:1.0:1788753080.747533:0:15149:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912128 00000100:00100000:1.0:1788753080.747626:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:1.0:1788753080.747637:0:15149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2360:x1875643164912128:12345-192.168.203.5@tcp:4:dd.0 00002000:00010000:1.0:1788753080.747695:0:15149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9e34b8, atime: 0x6a9e34b7, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788753080.747705:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.747722:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1788753080.747727:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.747733:0:15149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.747762:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.748788:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.750630:0:16689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912256 00000100:00100000:3.0:1788753080.750643:0:16689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912256 00000100:00100000:3.0:1788753080.752163:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753080.752195:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753080.753524:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912384 00000100:00100000:0.0:1788753080.753536:0:15147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912384 00000100:00100000:0.0:1788753080.753602:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912512 00000100:00100000:0.0:1788753080.753605:0:15147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912512 00000100:00100000:0.0:1788753080.753626:0:15147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 4 00000100:00100000:0.0:1788753080.753634:0:15147:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+9:2361:x1875643164912384:12345-192.168.203.5@tcp:4:dd.0 00010000:00010000:0.0:1788753080.753669:0:15147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.753686:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753080.753691:0:15147:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788753080.753697:0:15147:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788753080.753711:0:15147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753080.766748:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:0.0:1788753080.767022:0:16689:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788753080.767039:0:16689:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788753080.769463:0:16689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912640 00000100:00100000:0.0:1788753080.769477:0:16689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912640 00000100:00100000:2.0:1788753080.769980:0:16691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:2.0:1788753080.770006:0:16691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:472192c3-7fea-4fd7-bf59-65fb04537d51+11:2360:x1875643164912512:12345-192.168.203.5@tcp:4:dd.0 00010000:00010000:2.0:1788753080.770055:0:16691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.770074:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753080.770079:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753080.770087:0:16691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.770102:0:16691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788753080.841170:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1788753080.841333:0:15149:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:2.0:1788753080.841337:0:15149:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1788753080 -> 1788753081 00002000:00010000:2.0:1788753080.841340:0:15149:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788753081 00002000:00010000:2.0:1788753080.841343:0:15149:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1788753080.841359:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841373:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841382:0:15149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841390:0:15149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc9600 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:2.0:1788753080.841395:0:15149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841423:0:15149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841515:0:15149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841524:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a613a2/0x80c8383f48491450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788753080.841614:0:15149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+15:2360:x1875643164912128:12345-192.168.203.5@tcp:4:dd.0 Request processed in 93975us (96429us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788753080.841624:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 3 00000100:00100000:2.0:1788753080.841656:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 6 00000100:00100000:2.0:1788753080.841668:0:15149:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9baef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+14:2360:x1875643164912256:12345-192.168.203.5@tcp:4:dd.0 00010000:00010000:2.0:1788753080.841698:0:15149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841711:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753080.841716:0:15149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788753080.841721:0:15149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788753080.841732:0:15149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788753080.911784:0:15147:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1788753080.911806:0:15147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911831:0:15147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911841:0:15147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911849:0:15147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9a85e4da00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753080.911855:0:15147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911863:0:15147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911892:0:15147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911900:0:15147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006273eb3d/0x80c8383f48491457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911987:0:16691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.911997:0:16691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.912005:0:16691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.912011:0:16691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b1a00 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:1.0:1788753080.912014:0:16691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.912024:0:16691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.912036:0:16691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.912044:0:16691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054d10e6f/0x80c8383f4849145e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788753080.918702:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:1.0:1788753080.918724:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000100:00100000:1.0:1788753080.918795:0:16691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:472192c3-7fea-4fd7-bf59-65fb04537d51+11:2360:x1875643164912512:12345-192.168.203.5@tcp:4:dd.0 Request processed in 148798us (166592us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788753080.918834:0:16691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 5 00000100:00100000:1.0:1788753080.918867:0:16691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:1.0:1788753080.918891:0:16691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbdf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:472192c3-7fea-4fd7-bf59-65fb04537d51+10:2361:x1875643164912640:12345-192.168.203.5@tcp:4:dd.0 00010000:00010000:1.0:1788753080.918930:0:16691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.918947:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.918952:0:16691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788753080.918958:0:16691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788753080.918972:0:16691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788753080.919271:0:15147:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:472192c3-7fea-4fd7-bf59-65fb04537d51+11:2361:x1875643164912384:12345-192.168.203.5@tcp:4:dd.0 Request processed in 165636us (167153us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1788753080.919279:0:15147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 4 00010000:00010000:3.0:1788753080.943967:0:16042:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788753080.955264:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1788753080.956185:0:15149:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1788753080.956191:0:15149:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1788753080.956205:0:15149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.956229:0:15149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.956246:0:15149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.956254:0:15149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9bb55b0000 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753080.956258:0:15149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.956274:0:15149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.956308:0:15149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.956316:0:15149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000244c4d39/0x80c8383f48491465 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753080.956583:0:15149:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9baef1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:472192c3-7fea-4fd7-bf59-65fb04537d51+9:2360:x1875643164912256:12345-192.168.203.5@tcp:4:dd.0 Request processed in 114913us (207793us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788753080.956592:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 6 00000001:00080000:1.0:1788753080.995332:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1788753080.995605:0:16691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788753080.995621:0:16691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.995634:0:16691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.995642:0:16691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.995649:0:16691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9b88bc8200 already unused, calling callback (ffffffffc14dd940) 00010000:00010000:3.0:1788753080.995654:0:16691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.995662:0:16691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.995696:0:16691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788753080.995703:0:16691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea2cbfd0/0x80c8383f4849146c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788753080.996048:0:16691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbdf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2361:x1875643164912640:12345-192.168.203.5@tcp:4:dd.0 Request processed in 77167us (229303us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788753080.996059:0:16691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 7 00000100:00100000:3.0:1788753081.140179:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753081.140229:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753081.140249:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753081.140279:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753081.140300:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.5@tcp (source: 12345-192.168.203.5@tcp) 00000100:00100000:3.0:1788753081.140328:0:16038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164913280 00000100:00100000:3.0:1788753081.140337:0:16038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164913280 00000100:00100000:3.0:1788753081.140390:0:16038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912896 00000100:00100000:2.0:1788753081.140393:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164912768 00000100:00100000:3.0:1788753081.140394:0:16038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912896 00000100:00100000:2.0:1788753081.140397:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164912768 00000100:00100000:3.0:1788753081.140408:0:16038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164913152 00000100:00100000:3.0:1788753081.140410:0:16038:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164913152 00000100:00100000:3.0:1788753081.140423:0:16038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:2.0:1788753081.140424:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:3.0:1788753081.140432:0:16038:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2360:x1875643164913280:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788753081.140432:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9bbe213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:2360:x1875643164912768:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:1.0:1788753081.140516:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00100000:1.0:1788753081.140528:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2360:x1875643164912896:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:2.0:1788753081.140582:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9bbe213450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b4d3dae1-d843-4045-abf5-6b7f9bfffc0e+13:2360:x1875643164912768:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 149us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753081.140589:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 119 00000100:00100000:2.0:1788753081.140625:0:15144:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788753081.140633:0:15144:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788753081.140660:0:15141:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788753081.140686:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:2.0:1788753081.140692:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2360:x1875643164913152:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:0.0:1788753081.140755:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875643164913024 00000100:00100000:0.0:1788753081.140760:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875643164913024 00000100:00100000:0.0:1788753081.140805:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.5@tcp, seq: 20 00000100:00100000:0.0:1788753081.140822:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9a8704fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2360:x1875643164913024:12345-192.168.203.5@tcp:400:kworker.0 00000100:00100000:3.0:1788753081.142056:0:16038:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2360:x1875643164913280:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1615us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788753081.142058:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:472192c3-7fea-4fd7-bf59-65fb04537d51+5:2360:x1875643164912896:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 1522us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753081.142074:0:16038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 10 00000100:00100000:1.0:1788753081.142084:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 11 00000100:00080000:3.0:1788753081.142154:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788753081.142159:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788753081.142163:0:14451:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788753081.147071:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b96b9192-cdd9-4abe-9647-995a2cd48790+5:2360:x1875643164913152:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 6219us (6609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788753081.147087:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 12 00000100:00100000:3.0:1788753081.148924:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9a8704fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b96b9192-cdd9-4abe-9647-995a2cd48790+6:2360:x1875643164913024:12345-192.168.203.5@tcp:400:kworker.0 Request processed in 8095us (8685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788753081.148939:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.5@tcp, seq: 20 00010000:00010000:3.0:1788753081.963755:0:14444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788753082.473511:0:16730:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788753082.986506:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28626 lines, 28626 kept, 0 dropped, 0 bad.